Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 originally caused by: Started by upstream project "master-osmo-pcu" build number 5352 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6678 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6673 originally caused by: Started by upstream project "master-libgtpnl" build number 1809 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5150 originally caused by: Started by upstream project "master-osmo-pcu" build number 5352 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 originally caused by: Started by upstream project "master-osmo-pcu" build number 5352 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30034 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37184 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30035 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37185 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6673 originally caused by: Started by upstream project "master-libgtpnl" build number 1809 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8943 originally caused by: Started by upstream project "master-osmo-mgw" build number 9175 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17653 originally caused by: Started by upstream project "master-osmo-bsc" build number 20107 originally caused by: Started by upstream project "master-osmo-mgw" build number 9175 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29259 originally caused by: Started by upstream project "master-osmo-msc" build number 34203 originally caused by: Started by upstream project "master-osmo-mgw" build number 9175 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17653 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8943 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2947 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29259 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9238 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins14635006879595134947.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 09:50:07 + trial_dir_prefix=trial- + rm -rf trial-2357 trial-2357-bin.tgz trial-2357-run.tgz + trial_dir=trial-2358 + mkdir -p trial-2358 + mv open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2947.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29259.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30035.tgz osmo-stp.build-9238.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2358 + cat open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2947.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29259.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30035.md5 osmo-stp.build-9238.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2947.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29259.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30035.md5 osmo-stp.build-9238.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2358 combinations: None trial: 'trial-2358' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2358 -------------------------------------------------------------------------------------------- 09:50:18.912641 tst trial-2358: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/log --------------------------------------------------------------------- trial-2358 nitb_sms:sysmo --------------------------------------------------------------------- 09:52:26.316338 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:26.320452 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 09:52:26.341560 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 09:52:26.348442 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 09:52:26.402324 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 09:52:26.423216 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 09:52:26.429857 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 09:52:26.965873 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 09:52:26.970676 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 09:52:26.981510 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 09:52:27.354781 tst mo_mt_sms.py: using LAC 20642 09:52:27.589112 tst mo_mt_sms.py: using RAC 242 09:52:27.703771 tst mo_mt_sms.py: using CellId 20642 09:52:27.832872 tst mo_mt_sms.py: using BVCI 20643 09:52:27.949233 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 09:52:28.131060 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 09:52:28.245671 tst mo_mt_sms.py:9: start nitb and bts... 09:52:28.445397 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:52:30.681355 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22093): Launched 09:52:30.993235 run osmo-nitb_10.42.42.2(pid=22094): Launched 09:52:31.187806 run osmo-nitb_10.42.42.2(pid=22094): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22094)] 09:52:31.317453 run osmo-nitb_10.42.42.2(pid=22094): stdout: | (launched: 2022-12-09_09:52:30.932236) 09:52:31.446618 run osmo-nitb_10.42.42.2(pid=22094): stderr: | (launched: 2022-12-09_09:52:30.978256) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:52:31.576199 run osmo-nitb_10.42.42.2(pid=22094): stdout: | (launched: 2022-12-09_09:52:30.932236) 09:52:31.699364 run osmo-nitb_10.42.42.2(pid=22094): stderr: | (launched: 2022-12-09_09:52:30.978256) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:52:31.846694 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22094) [trial-2358↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22094)] [trial-2358↪nitb_sms:sysmo↪mo_mt_sms.py:11] 09:52:31.855970 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 09:52:31.863581 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22093): Terminating (SIGTERM) 09:52:32.076361 --- ParallelTerminationStrategy: PID 22093 died... 09:52:32.096443 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22093): Terminated: ok {rc=0} 09:52:32.193954 bus /sierra_3: Setting Powered False 09:52:33.297616 bus /sierra_3: Setting Powered False 09:52:34.418314 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:sysmo --------------------------------------------------------------------- 09:52:35.602738 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:35.607110 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 09:52:35.628704 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 09:52:35.656084 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 09:52:35.709428 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 09:52:35.730614 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 09:52:35.757713 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 09:52:36.305522 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:sysmo mo_mt_sms.py ---------------------------------------------- 09:52:36.310849 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:52:36.322021 tst sms:sysmo: Using 1 x bts (candidates: 1) 09:52:36.357564 tst mo_mt_sms.py: using LAC 20643 09:52:36.479901 tst mo_mt_sms.py: using RAC 243 09:52:36.599720 tst mo_mt_sms.py: using CellId 20643 09:52:36.727943 tst mo_mt_sms.py: using BVCI 20644 09:52:36.846171 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:52:36.857403 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:52:36.868372 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:52:36.879541 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:52:36.890805 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:52:36.901602 tst sms:sysmo: Using 1 x modem (candidates: 2) 09:52:37.014980 tst sms:sysmo: Using 1 x modem (candidates: 2) 09:52:37.134324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:38.852525 run create_hlr_db(pid=22099): Launched 09:52:38.978910 bus /sierra_2: Setting Powered False 09:52:40.039098 run create_hlr_db(pid=22099): Terminated: ok {rc=0} 09:52:40.485420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22101): Launched 09:52:40.814283 run osmo-hlr_10.42.42.2(pid=22102): Launched 09:52:40.940252 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:43.514085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22104): Launched 09:52:43.839303 run osmo-stp_10.42.42.5(pid=22105): Launched 09:52:43.964928 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:49.536907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22107): Launched 09:52:49.863261 run osmo-msc_10.42.42.6(pid=22108): Launched 09:52:50.044250 run osmo-stp_10.42.42.5(pid=22105): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22105)] 09:52:50.180110 run osmo-stp_10.42.42.5(pid=22105): stdout: | (launched: 2022-12-09_09:52:43.778688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:50.316607 run osmo-stp_10.42.42.5(pid=22105): stderr: | 20221209095243975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095243975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095243975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095243976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095243976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095243976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095243976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:50.452738 run osmo-stp_10.42.42.5(pid=22105): stdout: | (launched: 2022-12-09_09:52:43.778688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:50.582057 run osmo-stp_10.42.42.5(pid=22105): stderr: | 20221209095243975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095243975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095243975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095243976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095243976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095243976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095243976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:50.736295 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22105): Process ended prematurely: osmo-stp_10.42.42.5(pid=22105) [trial-2358↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22105)] [trial-2358↪sms:sysmo↪mo_mt_sms.py:16] 09:52:50.745559 tst mo_mt_sms.py:16: Test FAILED (14.4 sec) 09:52:50.773677 run osmo-hlr_10.42.42.2(pid=22102): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22102)] 09:52:50.824506 run osmo-hlr_10.42.42.2(pid=22102): stdout: | (launched: 2022-12-09_09:52:40.753238) 09:52:50.877598 run osmo-hlr_10.42.42.2(pid=22102): stderr: | 20221209095240955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095240955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095240955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095240955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095240955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095240956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095240968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095240976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095240976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095240976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:50.950856 run osmo-msc_10.42.42.6(pid=22108): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22108)] 09:52:51.002209 run osmo-msc_10.42.42.6(pid=22108): stdout: | (launched: 2022-12-09_09:52:49.802242) 09:52:51.054625 run osmo-msc_10.42.42.6(pid=22108): stderr: | 20221209095250129 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095250129 DLGLOBAL DEBUG validating counter group 0x7f43770c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095250129 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095250130 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095250130 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095250130 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095250132 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095250132 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095250132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095250132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:51.108188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22101): Terminating (SIGTERM) 09:52:51.150763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22104): Terminating (SIGTERM) 09:52:51.193189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22107): Terminating (SIGTERM) 09:52:51.235707 --- ParallelTerminationStrategy: PID 22101 died... 09:52:51.255950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22101): Terminated: ok {rc=0} 09:52:51.302960 --- ParallelTerminationStrategy: PID 22104 died... 09:52:51.322840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22104): Terminated: ok {rc=0} 09:52:51.369604 --- ParallelTerminationStrategy: PID 22107 died... 09:52:51.389382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22107): Terminated: ok {rc=0} 09:52:51.478942 bus /sierra_3: Setting Powered False 09:52:52.580193 bus /sierra_3: Setting Powered False 09:52:53.697037 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:sysmo --------------------------------------------------------------------- 09:52:54.916469 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:54.920240 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 09:52:54.940886 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 09:52:54.948518 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 09:52:54.988751 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 09:52:55.009533 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 09:52:55.016800 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 09:52:55.535569 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 09:52:55.540754 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 09:52:55.551567 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 09:52:55.588525 tst assert_extension.py: using LAC 20644 09:52:55.706548 tst assert_extension.py: using RAC 244 09:52:55.824337 tst assert_extension.py: using CellId 20644 09:52:55.942187 tst assert_extension.py: using BVCI 20645 09:52:56.052707 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 09:52:56.171990 tst assert_extension.py:10: start nitb and bts... 09:52:56.390333 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:52:57.053806 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22113): Launched 09:52:57.382387 run osmo-nitb_10.42.42.2(pid=22114): Launched 09:52:57.563194 run osmo-nitb_10.42.42.2(pid=22114): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22114)] 09:52:57.708190 run osmo-nitb_10.42.42.2(pid=22114): stdout: | (launched: 2022-12-09_09:52:57.321402) 09:52:57.855098 run osmo-nitb_10.42.42.2(pid=22114): stderr: | (launched: 2022-12-09_09:52:57.369805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:52:58.001486 run osmo-nitb_10.42.42.2(pid=22114): stdout: | (launched: 2022-12-09_09:52:57.321402) 09:52:58.142924 run osmo-nitb_10.42.42.2(pid=22114): stderr: | (launched: 2022-12-09_09:52:57.369805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22114) [trial-2358↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22114)] 09:52:58.506620 tst osmo-nitb_10.42.42.2(pid=22114): stdout: | (launched: 2022-12-09_09:52:57.321402) 09:52:58.638023 tst osmo-nitb_10.42.42.2(pid=22114): stderr: | (launched: 2022-12-09_09:52:57.369805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:52:58.792146 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22114) [trial-2358↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22114)] [trial-2358↪nitb_ussd:sysmo↪assert_extension.py:12] 09:52:58.801605 tst assert_extension.py:12: Test FAILED (3.3 sec) 09:52:58.808762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22113): Terminating (SIGTERM) 09:52:59.021196 --- ParallelTerminationStrategy: PID 22113 died... 09:52:59.042487 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22113): Terminated: ok {rc=0} 09:52:59.131748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:sysmo --------------------------------------------------------------------- 09:53:00.320902 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:00.326324 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 09:53:00.350954 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 09:53:00.378520 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 09:53:00.415759 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 09:53:00.436342 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 09:53:00.463093 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 09:53:01.015321 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:sysmo assert_extension.py ---------------------------------------------- 09:53:01.022860 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:53:01.039002 tst ussd:sysmo: Using 1 x bts (candidates: 1) 09:53:01.086022 tst assert_extension.py: using LAC 20645 09:53:01.216480 tst assert_extension.py: using RAC 245 09:53:01.348166 tst assert_extension.py: using CellId 20645 09:53:01.509449 tst assert_extension.py: using BVCI 20646 09:53:01.637660 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:53:01.649912 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:53:01.661614 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:53:01.673827 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:53:01.684903 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:53:01.695962 tst ussd:sysmo: Using 1 x modem (candidates: 1) 09:53:01.823290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:02.350984 run create_hlr_db(pid=22154): Launched 09:53:02.524195 bus /sierra_2: Setting Powered False 09:53:03.606745 run create_hlr_db(pid=22154): Terminated: ok {rc=0} 09:53:04.147070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22390): Launched 09:53:04.482051 run osmo-hlr_10.42.42.2(pid=22392): Launched 09:53:04.727002 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:05.342027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22394): Launched 09:53:05.686657 run osmo-stp_10.42.42.5(pid=22395): Launched 09:53:05.939228 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:06.599348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22399): Launched 09:53:06.927768 run osmo-msc_10.42.42.6(pid=22400): Launched 09:53:07.274936 run osmo-stp_10.42.42.5(pid=22395): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22395)] 09:53:07.553241 run osmo-stp_10.42.42.5(pid=22395): stdout: | (launched: 2022-12-09_09:53:05.625607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:07.818061 run osmo-stp_10.42.42.5(pid=22395): stderr: | 20221209095305925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095305925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095305926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095305926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095305928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095305928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095305928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:08.000007 run osmo-stp_10.42.42.5(pid=22395): stdout: | (launched: 2022-12-09_09:53:05.625607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:08.122236 run osmo-stp_10.42.42.5(pid=22395): stderr: | 20221209095305925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095305925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095305926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095305926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095305928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095305928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095305928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:08.291105 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22395): Process ended prematurely: osmo-stp_10.42.42.5(pid=22395) [trial-2358↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22395)] [trial-2358↪ussd:sysmo↪assert_extension.py:17] 09:53:08.300025 tst assert_extension.py:17: Test FAILED (7.3 sec) 09:53:08.329235 run osmo-hlr_10.42.42.2(pid=22392): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22392)] 09:53:08.379273 run osmo-hlr_10.42.42.2(pid=22392): stdout: | (launched: 2022-12-09_09:53:04.423125) 09:53:08.430645 run osmo-hlr_10.42.42.2(pid=22392): stderr: | 20221209095304766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095304766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095304767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095304767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095304767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095304767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095304787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095304798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095304799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095304799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:08.502299 run osmo-msc_10.42.42.6(pid=22400): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22400)] 09:53:08.552350 run osmo-msc_10.42.42.6(pid=22400): stdout: | (launched: 2022-12-09_09:53:06.864195) 09:53:08.604405 run osmo-msc_10.42.42.6(pid=22400): stderr: | 20221209095307458 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095307458 DLGLOBAL DEBUG validating counter group 0x7f9bb89ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095307458 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095307458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095307459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095307459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095307460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095307465 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095307465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095307465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:08.656249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22390): Terminating (SIGTERM) 09:53:08.698496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22394): Terminating (SIGTERM) 09:53:08.742075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22399): Terminating (SIGTERM) 09:53:08.786447 --- ParallelTerminationStrategy: PID 22390 died... 09:53:08.806276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22390): Terminated: ok {rc=0} 09:53:08.853753 --- ParallelTerminationStrategy: PID 22394 died... 09:53:08.873338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22394): Terminated: ok {rc=0} 09:53:08.919270 --- ParallelTerminationStrategy: PID 22399 died... 09:53:08.938963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22399): Terminated: ok {rc=0} 09:53:09.026856 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:53:10.224875 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:10.231959 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:53:10.253603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:53:10.282400 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:53:10.333921 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:53:10.355956 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:53:10.384661 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:53:10.931998 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:53:10.987202 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:10.999297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:53:11.058726 tst mo_mt_call.py: using LAC 20646 09:53:11.184063 tst mo_mt_call.py: using RAC 246 09:53:11.308093 tst mo_mt_call.py: using CellId 20646 09:53:11.432328 tst mo_mt_call.py: using BVCI 20647 09:53:11.550071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:11.562479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:11.575458 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:11.587314 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:11.599229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:11.611367 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:53:11.732221 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:53:11.852714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:12.351834 run create_hlr_db(pid=22405): Launched 09:53:12.518579 bus /sierra_2: Setting Powered False 09:53:13.584245 run create_hlr_db(pid=22405): Terminated: ok {rc=0} 09:53:14.031404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22407): Launched 09:53:14.368107 run osmo-hlr_10.42.42.2(pid=22408): Launched 09:53:14.614479 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:15.358107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22410): Launched 09:53:15.693396 run osmo-stp_10.42.42.5(pid=22411): Launched 09:53:15.934718 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:16.711429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22413): Launched 09:53:17.173184 run osmo-msc_10.42.42.6(pid=22414): Launched 09:53:17.610774 run osmo-stp_10.42.42.5(pid=22411): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22411)] 09:53:17.895041 run osmo-stp_10.42.42.5(pid=22411): stdout: | (launched: 2022-12-09_09:53:15.630454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:18.252847 run osmo-stp_10.42.42.5(pid=22411): stderr: | 20221209095315971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095315971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095315971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095315971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095315972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095315972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095315972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:18.424120 run osmo-stp_10.42.42.5(pid=22411): stdout: | (launched: 2022-12-09_09:53:15.630454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:18.550938 run osmo-stp_10.42.42.5(pid=22411): stderr: | 20221209095315971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095315971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095315971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095315971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095315972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095315972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095315972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:18.704498 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22411): Process ended prematurely: osmo-stp_10.42.42.5(pid=22411) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22411)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:53:18.714148 tst mo_mt_call.py:8: Test FAILED (7.8 sec) 09:53:18.742129 run osmo-hlr_10.42.42.2(pid=22408): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22408)] 09:53:18.793445 run osmo-hlr_10.42.42.2(pid=22408): stdout: | (launched: 2022-12-09_09:53:14.303922) 09:53:18.845476 run osmo-hlr_10.42.42.2(pid=22408): stderr: | 20221209095314656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095314656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095314656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095314656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095314662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095314663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095314683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095314691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095314691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095314691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:18.917805 run osmo-msc_10.42.42.6(pid=22414): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22414)] 09:53:18.967645 run osmo-msc_10.42.42.6(pid=22414): stdout: | (launched: 2022-12-09_09:53:17.095591) 09:53:19.020438 run osmo-msc_10.42.42.6(pid=22414): stderr: | 20221209095317778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095317789 DLGLOBAL DEBUG validating counter group 0x7f69787b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095317789 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095317789 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095317789 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095317790 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095317792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095317793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095317793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095317793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:19.073356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22407): Terminating (SIGTERM) 09:53:19.115983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22410): Terminating (SIGTERM) 09:53:19.162487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22413): Terminating (SIGTERM) 09:53:19.208426 --- ParallelTerminationStrategy: PID 22407 died... 09:53:19.228592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22407): Terminated: ok {rc=0} 09:53:19.277872 --- ParallelTerminationStrategy: PID 22410 died... 09:53:19.297917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22410): Terminated: ok {rc=0} 09:53:19.345601 --- ParallelTerminationStrategy: PID 22413 died... 09:53:19.365947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22413): Terminated: ok {rc=0} 09:53:19.455908 bus /sierra_3: Setting Powered False 09:53:20.558188 bus /sierra_3: Setting Powered False 09:53:21.679042 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:53:22.831906 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:22.844620 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:53:22.907864 tst mo_mt_call_osmux.py: using LAC 20647 09:53:23.034334 tst mo_mt_call_osmux.py: using RAC 247 09:53:23.162231 tst mo_mt_call_osmux.py: using CellId 20647 09:53:23.289783 tst mo_mt_call_osmux.py: using BVCI 20648 09:53:23.409555 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:23.421690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:23.434053 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:23.446568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:23.459388 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:53:23.471524 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:53:23.592317 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:53:23.715456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:24.221022 run create_hlr_db(pid=22416): Launched 09:53:24.387479 bus /sierra_2: Setting Powered False 09:53:25.448295 run create_hlr_db(pid=22416): Terminated: ok {rc=0} 09:53:25.905627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Launched 09:53:26.239418 run osmo-hlr_10.42.42.2(pid=22420): Launched 09:53:26.366423 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:26.944602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Launched 09:53:27.276069 run osmo-stp_10.42.42.5(pid=22423): Launched 09:53:27.402100 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:28.002516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Launched 09:53:28.334240 run osmo-msc_10.42.42.6(pid=22426): Launched 09:53:28.518003 run osmo-stp_10.42.42.5(pid=22423): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] 09:53:28.657284 run osmo-stp_10.42.42.5(pid=22423): stdout: | (launched: 2022-12-09_09:53:27.213972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:28.796853 run osmo-stp_10.42.42.5(pid=22423): stderr: | 20221209095327410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095327411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095327411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095327411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095327412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095327412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095327412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:28.928469 run osmo-stp_10.42.42.5(pid=22423): stdout: | (launched: 2022-12-09_09:53:27.213972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:29.051897 run osmo-stp_10.42.42.5(pid=22423): stderr: | 20221209095327410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095327411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095327411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095327411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095327412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095327412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095327412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:29.199205 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22423): Process ended prematurely: osmo-stp_10.42.42.5(pid=22423) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:53:29.208128 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:53:29.235202 run osmo-hlr_10.42.42.2(pid=22420): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22420)] 09:53:29.284405 run osmo-hlr_10.42.42.2(pid=22420): stdout: | (launched: 2022-12-09_09:53:26.176854) 09:53:29.334943 run osmo-hlr_10.42.42.2(pid=22420): stderr: | 20221209095326378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095326378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095326378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095326378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095326378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095326378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095326392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095326400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095326400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095326400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:29.404892 run osmo-msc_10.42.42.6(pid=22426): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22426)] 09:53:29.453836 run osmo-msc_10.42.42.6(pid=22426): stdout: | (launched: 2022-12-09_09:53:28.272191) 09:53:29.504168 run osmo-msc_10.42.42.6(pid=22426): stderr: | 20221209095328600 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095328600 DLGLOBAL DEBUG validating counter group 0x7fa0cb370c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095328600 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095328600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095328600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095328600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095328602 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095328603 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095328603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095328603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:29.554639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminating (SIGTERM) 09:53:29.594806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Terminating (SIGTERM) 09:53:29.635288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Terminating (SIGTERM) 09:53:29.676151 --- ParallelTerminationStrategy: PID 22419 died... 09:53:29.695628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminated: ok {rc=0} 09:53:29.740609 --- ParallelTerminationStrategy: PID 22422 died... 09:53:29.759834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Terminated: ok {rc=0} 09:53:29.804842 --- ParallelTerminationStrategy: PID 22425 died... 09:53:29.824221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Terminated: ok {rc=0} 09:53:29.909323 bus /sierra_3: Setting Powered False 09:53:31.014283 bus /sierra_3: Setting Powered False 09:53:32.151325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:53:33.393924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:33.400911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:53:33.423314 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:53:33.451134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:53:33.503961 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:53:33.525521 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:53:33.553306 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:53:34.108018 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:53:34.161754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:34.173211 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:53:34.229867 tst mo_mt_call.py: using LAC 20648 09:53:34.361823 tst mo_mt_call.py: using RAC 248 09:53:34.486763 tst mo_mt_call.py: using CellId 20648 09:53:34.608383 tst mo_mt_call.py: using BVCI 20649 09:53:34.719917 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:34.731113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:34.742082 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:34.752787 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:34.763621 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:34.774456 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:53:34.893811 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:53:35.010741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:35.493428 run create_hlr_db(pid=22431): Launched 09:53:35.621286 bus /sierra_2: Setting Powered False 09:53:36.682687 run create_hlr_db(pid=22431): Terminated: ok {rc=0} 09:53:37.136056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Launched 09:53:37.468771 run osmo-hlr_10.42.42.2(pid=22434): Launched 09:53:37.596716 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:38.170017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Launched 09:53:38.502382 run osmo-stp_10.42.42.5(pid=22437): Launched 09:53:38.629792 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:39.231760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22439): Launched 09:53:39.565585 run osmo-msc_10.42.42.6(pid=22440): Launched 09:53:39.751114 run osmo-stp_10.42.42.5(pid=22437): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] 09:53:39.891869 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-09_09:53:38.439967) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:40.034173 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221209095338636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095338636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095338636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095338637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095338637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095338637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095338637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:40.172905 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-09_09:53:38.439967) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:40.305957 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221209095338636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095338636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095338636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095338637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095338637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095338637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095338637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:40.465330 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:53:40.475054 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:53:40.503461 run osmo-hlr_10.42.42.2(pid=22434): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22434)] 09:53:40.554362 run osmo-hlr_10.42.42.2(pid=22434): stdout: | (launched: 2022-12-09_09:53:37.406944) 09:53:40.606694 run osmo-hlr_10.42.42.2(pid=22434): stderr: | 20221209095337610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095337610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095337610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095337610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095337610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095337610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095337647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095337657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095337657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095337657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:40.679803 run osmo-msc_10.42.42.6(pid=22440): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22440)] 09:53:40.730506 run osmo-msc_10.42.42.6(pid=22440): stdout: | (launched: 2022-12-09_09:53:39.503185) 09:53:40.782766 run osmo-msc_10.42.42.6(pid=22440): stderr: | 20221209095339829 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095339829 DLGLOBAL DEBUG validating counter group 0x7f96e72c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095339829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095339830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095339830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095339830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095339831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095339832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095339832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095339832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:40.835870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminating (SIGTERM) 09:53:40.878347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminating (SIGTERM) 09:53:40.920728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22439): Terminating (SIGTERM) 09:53:40.963639 --- ParallelTerminationStrategy: PID 22433 died... 09:53:40.983589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminated: ok {rc=0} 09:53:41.030311 --- ParallelTerminationStrategy: PID 22436 died... 09:53:41.049856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminated: ok {rc=0} 09:53:41.096801 --- ParallelTerminationStrategy: PID 22439 died... 09:53:41.116892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22439): Terminated: ok {rc=0} 09:53:41.206279 bus /sierra_3: Setting Powered False 09:53:42.306342 bus /sierra_3: Setting Powered False 09:53:43.424599 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:53:44.575697 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:44.587758 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:53:44.660489 tst mo_mt_call_osmux.py: using LAC 20649 09:53:44.794689 tst mo_mt_call_osmux.py: using RAC 249 09:53:44.926706 tst mo_mt_call_osmux.py: using CellId 20649 09:53:45.058708 tst mo_mt_call_osmux.py: using BVCI 20650 09:53:45.179746 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:45.191338 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:45.202753 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:45.214297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:45.225860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:53:45.237496 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:53:45.357392 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:53:45.478986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:46.030170 run create_hlr_db(pid=22442): Launched 09:53:46.188490 bus /sierra_2: Setting Powered False 09:53:47.253689 run create_hlr_db(pid=22442): Terminated: ok {rc=0} 09:53:47.699766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22444): Launched 09:53:48.011653 run osmo-hlr_10.42.42.2(pid=22445): Launched 09:53:48.130933 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:48.686543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22447): Launched 09:53:48.996776 run osmo-stp_10.42.42.5(pid=22448): Launched 09:53:49.113936 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:49.673350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22450): Launched 09:53:49.986817 run osmo-msc_10.42.42.6(pid=22451): Launched 09:53:50.160053 run osmo-stp_10.42.42.5(pid=22448): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22448)] 09:53:50.291117 run osmo-stp_10.42.42.5(pid=22448): stdout: | (launched: 2022-12-09_09:53:48.938113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:50.422197 run osmo-stp_10.42.42.5(pid=22448): stderr: | 20221209095349110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095349110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095349110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095349111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095349113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095349113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095349113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:50.551040 run osmo-stp_10.42.42.5(pid=22448): stdout: | (launched: 2022-12-09_09:53:48.938113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:50.675254 run osmo-stp_10.42.42.5(pid=22448): stderr: | 20221209095349110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095349110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095349110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095349111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095349113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095349113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095349113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:50.823033 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22448): Process ended prematurely: osmo-stp_10.42.42.5(pid=22448) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22448)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:53:50.832110 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:53:50.858873 run osmo-hlr_10.42.42.2(pid=22445): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22445)] 09:53:50.907417 run osmo-hlr_10.42.42.2(pid=22445): stdout: | (launched: 2022-12-09_09:53:47.952712) 09:53:50.957707 run osmo-hlr_10.42.42.2(pid=22445): stderr: | 20221209095348132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095348132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095348132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095348132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095348132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095348132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095348144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095348152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095348153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095348153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:51.027616 run osmo-msc_10.42.42.6(pid=22451): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22451)] 09:53:51.076059 run osmo-msc_10.42.42.6(pid=22451): stdout: | (launched: 2022-12-09_09:53:49.927501) 09:53:51.126245 run osmo-msc_10.42.42.6(pid=22451): stderr: | 20221209095350206 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095350206 DLGLOBAL DEBUG validating counter group 0x7f70382ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095350206 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095350206 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095350206 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095350206 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095350208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095350208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095350209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095350209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:51.176847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22444): Terminating (SIGTERM) 09:53:51.217237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22447): Terminating (SIGTERM) 09:53:51.257479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22450): Terminating (SIGTERM) 09:53:51.297859 --- ParallelTerminationStrategy: PID 22444 died... 09:53:51.317133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22444): Terminated: ok {rc=0} 09:53:51.361380 --- ParallelTerminationStrategy: PID 22447 died... 09:53:51.380075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22447): Terminated: ok {rc=0} 09:53:51.424846 --- ParallelTerminationStrategy: PID 22450 died... 09:53:51.444045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22450): Terminated: ok {rc=0} 09:53:51.528757 bus /sierra_3: Setting Powered False 09:53:52.625818 bus /sierra_3: Setting Powered False 09:53:53.741781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:53:54.976434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:54.982986 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:53:55.003543 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:53:55.031537 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:53:55.083553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:53:55.104251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:53:55.130630 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:53:55.680412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:53:55.729825 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:53:55.740650 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:53:55.795557 tst mo_mt_call.py: using LAC 20650 09:53:55.917215 tst mo_mt_call.py: using RAC 250 09:53:56.040128 tst mo_mt_call.py: using CellId 20650 09:53:56.163205 tst mo_mt_call.py: using BVCI 20651 09:53:56.277093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:53:56.288216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:53:56.299057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:53:56.309925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:53:56.320662 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:53:56.331618 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:53:56.452166 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:53:56.570278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:57.052768 run create_hlr_db(pid=22459): Launched 09:53:57.178663 bus /sierra_2: Setting Powered False 09:53:58.240284 run create_hlr_db(pid=22459): Terminated: ok {rc=0} 09:53:58.694290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22461): Launched 09:53:59.027030 run osmo-hlr_10.42.42.2(pid=22462): Launched 09:53:59.153468 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:59.728465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22464): Launched 09:54:00.061902 run osmo-stp_10.42.42.5(pid=22465): Launched 09:54:00.187811 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:00.788314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22467): Launched 09:54:01.140511 run osmo-msc_10.42.42.6(pid=22468): Launched 09:54:01.451905 run osmo-stp_10.42.42.5(pid=22465): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22465)] 09:54:01.681237 run osmo-stp_10.42.42.5(pid=22465): stdout: | (launched: 2022-12-09_09:53:59.999630) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:01.953302 run osmo-stp_10.42.42.5(pid=22465): stderr: | 20221209095400196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095400196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095400196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095400197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095400197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095400198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095400198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:02.177809 run osmo-stp_10.42.42.5(pid=22465): stdout: | (launched: 2022-12-09_09:53:59.999630) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:02.318486 run osmo-stp_10.42.42.5(pid=22465): stderr: | 20221209095400196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095400196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095400196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095400197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095400197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095400198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095400198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:02.483253 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22465): Process ended prematurely: osmo-stp_10.42.42.5(pid=22465) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22465)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:54:02.493660 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 09:54:02.524387 run osmo-hlr_10.42.42.2(pid=22462): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22462)] 09:54:02.576726 run osmo-hlr_10.42.42.2(pid=22462): stdout: | (launched: 2022-12-09_09:53:58.964647) 09:54:02.630421 run osmo-hlr_10.42.42.2(pid=22462): stderr: | 20221209095359165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095359165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095359165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095359165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095359165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095359165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095359178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095359187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095359187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095359187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:02.704635 run osmo-msc_10.42.42.6(pid=22468): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22468)] 09:54:02.756544 run osmo-msc_10.42.42.6(pid=22468): stdout: | (launched: 2022-12-09_09:54:01.076053) 09:54:02.810111 run osmo-msc_10.42.42.6(pid=22468): stderr: | 20221209095401679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095401679 DLGLOBAL DEBUG validating counter group 0x7f869cbf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095401679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095401679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095401679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095401679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095401684 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095401687 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095401687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095401687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:02.864263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22461): Terminating (SIGTERM) 09:54:02.908353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22464): Terminating (SIGTERM) 09:54:02.951513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22467): Terminating (SIGTERM) 09:54:02.994880 --- ParallelTerminationStrategy: PID 22461 died... 09:54:03.015092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22461): Terminated: ok {rc=0} 09:54:03.063654 --- ParallelTerminationStrategy: PID 22464 died... 09:54:03.083621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22464): Terminated: ok {rc=0} 09:54:03.132203 --- ParallelTerminationStrategy: PID 22467 died... 09:54:03.152170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22467): Terminated: ok {rc=0} 09:54:03.243304 bus /sierra_3: Setting Powered False 09:54:04.343570 bus /sierra_3: Setting Powered False 09:54:05.461743 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:54:06.608231 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:54:06.620077 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:54:06.681433 tst mo_mt_call_osmux.py: using LAC 20651 09:54:06.801406 tst mo_mt_call_osmux.py: using RAC 251 09:54:06.923232 tst mo_mt_call_osmux.py: using CellId 20651 09:54:07.044639 tst mo_mt_call_osmux.py: using BVCI 20652 09:54:07.156543 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:54:07.167611 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:54:07.178569 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:54:07.189393 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:54:07.200101 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:54:07.210943 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:54:07.330553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:54:07.452637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:07.970688 run create_hlr_db(pid=22470): Launched 09:54:08.097231 bus /sierra_2: Setting Powered False 09:54:09.162792 run create_hlr_db(pid=22470): Terminated: ok {rc=0} 09:54:09.626395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22472): Launched 09:54:09.960234 run osmo-hlr_10.42.42.2(pid=22473): Launched 09:54:10.087702 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:10.666354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22475): Launched 09:54:11.001346 run osmo-stp_10.42.42.5(pid=22476): Launched 09:54:11.130109 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:11.733799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22478): Launched 09:54:12.068210 run osmo-msc_10.42.42.6(pid=22479): Launched 09:54:12.252485 run osmo-stp_10.42.42.5(pid=22476): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22476)] 09:54:12.391876 run osmo-stp_10.42.42.5(pid=22476): stdout: | (launched: 2022-12-09_09:54:10.939318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:12.531827 run osmo-stp_10.42.42.5(pid=22476): stderr: | 20221209095411136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095411137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095411137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095411137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095411138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095411138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095411138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:12.678677 run osmo-stp_10.42.42.5(pid=22476): stdout: | (launched: 2022-12-09_09:54:10.939318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:12.808424 run osmo-stp_10.42.42.5(pid=22476): stderr: | 20221209095411136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095411137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095411137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095411137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095411138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095411138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095411138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:12.964508 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22476): Process ended prematurely: osmo-stp_10.42.42.5(pid=22476) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22476)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:54:12.974470 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:54:13.003434 run osmo-hlr_10.42.42.2(pid=22473): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22473)] 09:54:13.054213 run osmo-hlr_10.42.42.2(pid=22473): stdout: | (launched: 2022-12-09_09:54:09.897990) 09:54:13.106761 run osmo-hlr_10.42.42.2(pid=22473): stderr: | 20221209095410101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095410101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095410101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095410101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095410101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095410101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095410118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095410128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095410128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095410128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:13.179979 run osmo-msc_10.42.42.6(pid=22479): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22479)] 09:54:13.230882 run osmo-msc_10.42.42.6(pid=22479): stdout: | (launched: 2022-12-09_09:54:12.005568) 09:54:13.283315 run osmo-msc_10.42.42.6(pid=22479): stderr: | 20221209095412332 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095412332 DLGLOBAL DEBUG validating counter group 0x7ff47379ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095412333 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095412333 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095412333 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095412333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095412335 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095412335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095412335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095412335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:13.336056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22472): Terminating (SIGTERM) 09:54:13.378564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22475): Terminating (SIGTERM) 09:54:13.420832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22478): Terminating (SIGTERM) 09:54:13.463271 --- ParallelTerminationStrategy: PID 22472 died... 09:54:13.483390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22472): Terminated: ok {rc=0} 09:54:13.531090 --- ParallelTerminationStrategy: PID 22475 died... 09:54:13.550863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22475): Terminated: ok {rc=0} 09:54:13.597762 --- ParallelTerminationStrategy: PID 22478 died... 09:54:13.617540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22478): Terminated: ok {rc=0} 09:54:13.705451 bus /sierra_3: Setting Powered False 09:54:14.803762 bus /sierra_3: Setting Powered False 09:54:15.939511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:54:17.197509 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:17.204018 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:54:17.225037 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:54:17.251637 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:54:17.304054 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:54:17.325420 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:54:17.351404 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:54:17.899064 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:54:17.947196 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:17.958041 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:54:18.013149 tst mo_mt_call.py: using LAC 20652 09:54:18.134559 tst mo_mt_call.py: using RAC 252 09:54:18.261300 tst mo_mt_call.py: using CellId 20652 09:54:18.389294 tst mo_mt_call.py: using BVCI 20653 09:54:18.507922 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:18.519535 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:18.530939 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:18.543852 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:18.555259 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:18.567276 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:54:18.682699 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:54:18.797972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:19.304233 run create_hlr_db(pid=22485): Launched 09:54:19.427355 bus /sierra_2: Setting Powered False 09:54:20.491076 run create_hlr_db(pid=22485): Terminated: ok {rc=0} 09:54:20.942474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22487): Launched 09:54:21.267384 run osmo-hlr_10.42.42.2(pid=22488): Launched 09:54:21.392867 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:21.956350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22490): Launched 09:54:22.282540 run osmo-stp_10.42.42.5(pid=22491): Launched 09:54:22.406243 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:22.993700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22493): Launched 09:54:23.319064 run osmo-msc_10.42.42.6(pid=22494): Launched 09:54:23.499683 run osmo-stp_10.42.42.5(pid=22491): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22491)] 09:54:23.636801 run osmo-stp_10.42.42.5(pid=22491): stdout: | (launched: 2022-12-09_09:54:22.221319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:23.773963 run osmo-stp_10.42.42.5(pid=22491): stderr: | 20221209095422417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095422417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095422417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095422418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095422418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095422418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095422418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:23.910703 run osmo-stp_10.42.42.5(pid=22491): stdout: | (launched: 2022-12-09_09:54:22.221319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:24.040229 run osmo-stp_10.42.42.5(pid=22491): stderr: | 20221209095422417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095422417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095422417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095422418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095422418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095422418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095422418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:24.195793 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22491): Process ended prematurely: osmo-stp_10.42.42.5(pid=22491) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22491)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:54:24.205542 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:54:24.233817 run osmo-hlr_10.42.42.2(pid=22488): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22488)] 09:54:24.284488 run osmo-hlr_10.42.42.2(pid=22488): stdout: | (launched: 2022-12-09_09:54:21.206886) 09:54:24.336583 run osmo-hlr_10.42.42.2(pid=22488): stderr: | 20221209095421409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095421409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095421409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095421409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095421409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095421409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095421420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095421429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095421429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095421429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:24.408815 run osmo-msc_10.42.42.6(pid=22494): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22494)] 09:54:24.459065 run osmo-msc_10.42.42.6(pid=22494): stdout: | (launched: 2022-12-09_09:54:23.258157) 09:54:24.510993 run osmo-msc_10.42.42.6(pid=22494): stderr: | 20221209095423582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095423582 DLGLOBAL DEBUG validating counter group 0x7f0a9ef4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095423582 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095423582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095423583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095423583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095423584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095423585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095423585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095423585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:24.563389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22487): Terminating (SIGTERM) 09:54:24.605224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22490): Terminating (SIGTERM) 09:54:24.647198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22493): Terminating (SIGTERM) 09:54:24.689506 --- ParallelTerminationStrategy: PID 22487 died... 09:54:24.709536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22487): Terminated: ok {rc=0} 09:54:24.756223 --- ParallelTerminationStrategy: PID 22490 died... 09:54:24.775707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22490): Terminated: ok {rc=0} 09:54:24.822551 --- ParallelTerminationStrategy: PID 22493 died... 09:54:24.842270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22493): Terminated: ok {rc=0} 09:54:24.931518 bus /sierra_3: Setting Powered False 09:54:26.030736 bus /sierra_3: Setting Powered False 09:54:27.147089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:54:28.291412 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:28.303035 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:54:28.359629 tst mo_mt_call_osmux.py: using LAC 20653 09:54:28.479797 tst mo_mt_call_osmux.py: using RAC 253 09:54:28.601117 tst mo_mt_call_osmux.py: using CellId 20653 09:54:28.720668 tst mo_mt_call_osmux.py: using BVCI 20654 09:54:28.831886 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:28.842783 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:28.853528 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:28.864115 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:28.874880 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:54:28.885663 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:54:29.003927 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:54:29.123653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:29.631221 run create_hlr_db(pid=22496): Launched 09:54:29.755454 bus /sierra_2: Setting Powered False 09:54:30.819869 run create_hlr_db(pid=22496): Terminated: ok {rc=0} 09:54:31.274008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22498): Launched 09:54:31.615445 run osmo-hlr_10.42.42.2(pid=22499): Launched 09:54:31.731510 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:32.512289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22501): Launched 09:54:32.815942 run osmo-stp_10.42.42.5(pid=22502): Launched 09:54:32.931375 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:33.496137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22504): Launched 09:54:33.798674 run osmo-msc_10.42.42.6(pid=22505): Launched 09:54:33.966910 run osmo-stp_10.42.42.5(pid=22502): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22502)] 09:54:34.094172 run osmo-stp_10.42.42.5(pid=22502): stdout: | (launched: 2022-12-09_09:54:32.758888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:34.221749 run osmo-stp_10.42.42.5(pid=22502): stderr: | 20221209095432930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095432930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095432931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095432931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095432932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095432932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095432932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:34.347742 run osmo-stp_10.42.42.5(pid=22502): stdout: | (launched: 2022-12-09_09:54:32.758888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:34.468101 run osmo-stp_10.42.42.5(pid=22502): stderr: | 20221209095432930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095432930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095432931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095432931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095432932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095432932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095432932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:34.612127 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22502): Process ended prematurely: osmo-stp_10.42.42.5(pid=22502) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22502)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:54:34.621102 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:54:34.647374 run osmo-hlr_10.42.42.2(pid=22499): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22499)] 09:54:34.695129 run osmo-hlr_10.42.42.2(pid=22499): stdout: | (launched: 2022-12-09_09:54:31.542009) 09:54:34.744596 run osmo-hlr_10.42.42.2(pid=22499): stderr: | 20221209095431911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095431911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095431912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095431912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095431912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095431912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095431930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095431944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095431945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095431945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:34.813742 run osmo-msc_10.42.42.6(pid=22505): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22505)] 09:54:34.861443 run osmo-msc_10.42.42.6(pid=22505): stdout: | (launched: 2022-12-09_09:54:33.741356) 09:54:34.910900 run osmo-msc_10.42.42.6(pid=22505): stderr: | 20221209095434016 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095434016 DLGLOBAL DEBUG validating counter group 0x7fe44bff0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095434016 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095434016 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095434016 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095434017 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095434018 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095434019 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095434020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095434020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:34.960457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22498): Terminating (SIGTERM) 09:54:34.999890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22501): Terminating (SIGTERM) 09:54:35.039429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22504): Terminating (SIGTERM) 09:54:35.079177 --- ParallelTerminationStrategy: PID 22498 died... 09:54:35.098204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22498): Terminated: ok {rc=0} 09:54:35.142029 --- ParallelTerminationStrategy: PID 22501 died... 09:54:35.160372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22501): Terminated: ok {rc=0} 09:54:35.204006 --- ParallelTerminationStrategy: PID 22504 died... 09:54:35.222409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22504): Terminated: ok {rc=0} 09:54:35.307832 bus /sierra_3: Setting Powered False 09:54:36.407790 bus /sierra_3: Setting Powered False 09:54:37.520585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:54:38.755397 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:38.762475 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:54:38.784676 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:54:38.812197 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:54:38.865456 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:54:38.886700 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:54:38.914505 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:54:39.467130 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:54:39.521623 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:39.533454 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:54:39.589609 tst mo_mt_call.py: using LAC 20654 09:54:39.718241 tst mo_mt_call.py: using RAC 254 09:54:39.844263 tst mo_mt_call.py: using CellId 20654 09:54:39.972562 tst mo_mt_call.py: using BVCI 20655 09:54:40.090993 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:40.102479 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:40.113708 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:40.125121 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:40.136519 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:40.147952 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:54:40.263585 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:54:40.379100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:40.853885 run create_hlr_db(pid=22510): Launched 09:54:40.977442 bus /sierra_2: Setting Powered False 09:54:42.037958 run create_hlr_db(pid=22510): Terminated: ok {rc=0} 09:54:42.482743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22512): Launched 09:54:42.809957 run osmo-hlr_10.42.42.2(pid=22513): Launched 09:54:42.935199 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:43.530806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22515): Launched 09:54:43.852893 run osmo-stp_10.42.42.5(pid=22516): Launched 09:54:43.974412 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:44.554601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22518): Launched 09:54:44.877915 run osmo-msc_10.42.42.6(pid=22519): Launched 09:54:45.057426 run osmo-stp_10.42.42.5(pid=22516): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22516)] 09:54:45.192897 run osmo-stp_10.42.42.5(pid=22516): stdout: | (launched: 2022-12-09_09:54:43.790718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:45.328530 run osmo-stp_10.42.42.5(pid=22516): stderr: | 20221209095443983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095443983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095443983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095443984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095443984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095443984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095443984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:45.463455 run osmo-stp_10.42.42.5(pid=22516): stdout: | (launched: 2022-12-09_09:54:43.790718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:45.591806 run osmo-stp_10.42.42.5(pid=22516): stderr: | 20221209095443983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095443983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095443983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095443984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095443984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095443984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095443984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:45.745561 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22516): Process ended prematurely: osmo-stp_10.42.42.5(pid=22516) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22516)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:54:45.754988 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:54:45.782987 run osmo-hlr_10.42.42.2(pid=22513): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22513)] 09:54:45.843035 run osmo-hlr_10.42.42.2(pid=22513): stdout: | (launched: 2022-12-09_09:54:42.748923) 09:54:45.918548 run osmo-hlr_10.42.42.2(pid=22513): stderr: | 20221209095442948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095442948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095442948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095442948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095442948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095442948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095442961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095442969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095442969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095442969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:45.991126 run osmo-msc_10.42.42.6(pid=22519): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22519)] 09:54:46.049754 run osmo-msc_10.42.42.6(pid=22519): stdout: | (launched: 2022-12-09_09:54:44.815038) 09:54:46.111445 run osmo-msc_10.42.42.6(pid=22519): stderr: | 20221209095445138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095445138 DLGLOBAL DEBUG validating counter group 0x7f9e6e6ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095445138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095445138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095445138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095445138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095445140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095445140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095445141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095445141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:46.175246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22512): Terminating (SIGTERM) 09:54:46.229258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22515): Terminating (SIGTERM) 09:54:46.274693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22518): Terminating (SIGTERM) 09:54:46.319995 --- ParallelTerminationStrategy: PID 22512 died... 09:54:46.340888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22512): Terminated: ok {rc=0} 09:54:46.391021 --- ParallelTerminationStrategy: PID 22515 died... 09:54:46.411978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22515): Terminated: ok {rc=0} 09:54:46.462760 --- ParallelTerminationStrategy: PID 22518 died... 09:54:46.483976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22518): Terminated: ok {rc=0} 09:54:46.578408 bus /sierra_3: Setting Powered False 09:54:47.679572 bus /sierra_3: Setting Powered False 09:54:48.797207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:54:49.947238 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:49.959353 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:54:50.018112 tst mo_mt_call_osmux.py: using LAC 20655 09:54:50.145661 tst mo_mt_call_osmux.py: using RAC 255 09:54:50.264197 tst mo_mt_call_osmux.py: using CellId 20655 09:54:50.386812 tst mo_mt_call_osmux.py: using BVCI 20656 09:54:50.495135 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:50.506298 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:50.517227 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:50.528469 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:50.539499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:54:50.550510 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:54:50.666595 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:54:50.790457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:51.291784 run create_hlr_db(pid=22521): Launched 09:54:51.414866 bus /sierra_2: Setting Powered False 09:54:52.478600 run create_hlr_db(pid=22521): Terminated: ok {rc=0} 09:54:52.906428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22523): Launched 09:54:53.204346 run osmo-hlr_10.42.42.2(pid=22524): Launched 09:54:53.318297 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:53.857083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22526): Launched 09:54:54.155680 run osmo-stp_10.42.42.5(pid=22527): Launched 09:54:54.269636 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:54.812228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22529): Launched 09:54:55.111438 run osmo-msc_10.42.42.6(pid=22530): Launched 09:54:55.277724 run osmo-stp_10.42.42.5(pid=22527): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22527)] 09:54:55.404160 run osmo-stp_10.42.42.5(pid=22527): stdout: | (launched: 2022-12-09_09:54:54.100613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:55.530358 run osmo-stp_10.42.42.5(pid=22527): stderr: | 20221209095454269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095454269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095454269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095454270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095454270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095454270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095454270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:55.655244 run osmo-stp_10.42.42.5(pid=22527): stdout: | (launched: 2022-12-09_09:54:54.100613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:55.774860 run osmo-stp_10.42.42.5(pid=22527): stderr: | 20221209095454269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095454269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095454269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095454270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095454270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095454270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095454270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:55.918227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22527): Process ended prematurely: osmo-stp_10.42.42.5(pid=22527) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22527)] [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:54:55.927037 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:54:55.953256 run osmo-hlr_10.42.42.2(pid=22524): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22524)] 09:54:56.000884 run osmo-hlr_10.42.42.2(pid=22524): stdout: | (launched: 2022-12-09_09:54:53.149423) 09:54:56.050216 run osmo-hlr_10.42.42.2(pid=22524): stderr: | 20221209095453324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095453324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095453324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095453325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095453325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095453325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095453337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095453346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095453346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095453346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:56.118865 run osmo-msc_10.42.42.6(pid=22530): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22530)] 09:54:56.166383 run osmo-msc_10.42.42.6(pid=22530): stdout: | (launched: 2022-12-09_09:54:55.056341) 09:54:56.216059 run osmo-msc_10.42.42.6(pid=22530): stderr: | 20221209095455328 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095455328 DLGLOBAL DEBUG validating counter group 0x7f8e0cdefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095455329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095455329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095455329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095455329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095455331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095455331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095455331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095455331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:56.265815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22523): Terminating (SIGTERM) 09:54:56.305630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22526): Terminating (SIGTERM) 09:54:56.345469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22529): Terminating (SIGTERM) 09:54:56.386064 --- ParallelTerminationStrategy: PID 22523 died... 09:54:56.405193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22523): Terminated: ok {rc=0} 09:54:56.449331 --- ParallelTerminationStrategy: PID 22526 died... 09:54:56.468000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22526): Terminated: ok {rc=0} 09:54:56.511997 --- ParallelTerminationStrategy: PID 22529 died... 09:54:56.530619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22529): Terminated: ok {rc=0} 09:54:56.616243 bus /sierra_3: Setting Powered False 09:54:57.714978 bus /sierra_3: Setting Powered False 09:54:58.828736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:55:00.063582 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:00.070505 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:55:00.092252 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:55:00.119775 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:55:00.175831 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:55:00.197319 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:55:00.225298 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:55:00.771901 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:55:00.821635 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:00.850406 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:55:00.926390 tst mo_mt_call.py: using LAC 20656 09:55:01.060140 tst mo_mt_call.py: using RAC 1 09:55:01.178474 tst mo_mt_call.py: using CellId 20656 09:55:01.296589 tst mo_mt_call.py: using BVCI 20657 09:55:01.407114 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:01.418997 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:01.430409 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:01.441957 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:01.453465 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:01.464812 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:55:01.583880 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:55:01.711519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:02.271642 run create_hlr_db(pid=22538): Launched 09:55:02.411252 bus /sierra_2: Setting Powered False 09:55:03.471304 run create_hlr_db(pid=22538): Terminated: ok {rc=0} 09:55:03.911399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22540): Launched 09:55:04.215814 run osmo-hlr_10.42.42.2(pid=22541): Launched 09:55:04.330637 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:04.849728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22543): Launched 09:55:05.147477 run osmo-stp_10.42.42.5(pid=22544): Launched 09:55:05.260806 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:05.801476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22546): Launched 09:55:06.101526 run osmo-msc_10.42.42.6(pid=22547): Launched 09:55:06.269897 run osmo-stp_10.42.42.5(pid=22544): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22544)] 09:55:06.396691 run osmo-stp_10.42.42.5(pid=22544): stdout: | (launched: 2022-12-09_09:55:05.092792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:06.524630 run osmo-stp_10.42.42.5(pid=22544): stderr: | 20221209095505262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095505262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095505262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095505262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095505263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095505263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095505263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:06.650517 run osmo-stp_10.42.42.5(pid=22544): stdout: | (launched: 2022-12-09_09:55:05.092792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:06.771273 run osmo-stp_10.42.42.5(pid=22544): stderr: | 20221209095505262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095505262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095505262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095505262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095505263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095505263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095505263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:06.915347 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22544): Process ended prematurely: osmo-stp_10.42.42.5(pid=22544) [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22544)] [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:55:06.924437 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:55:06.950783 run osmo-hlr_10.42.42.2(pid=22541): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22541)] 09:55:06.998985 run osmo-hlr_10.42.42.2(pid=22541): stdout: | (launched: 2022-12-09_09:55:04.161072) 09:55:07.048337 run osmo-hlr_10.42.42.2(pid=22541): stderr: | 20221209095504332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095504332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095504332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095504332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095504332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095504332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095504344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095504353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095504353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095504353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:07.117331 run osmo-msc_10.42.42.6(pid=22547): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22547)] 09:55:07.164700 run osmo-msc_10.42.42.6(pid=22547): stdout: | (launched: 2022-12-09_09:55:06.045994) 09:55:07.213431 run osmo-msc_10.42.42.6(pid=22547): stderr: | 20221209095506318 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095506318 DLGLOBAL DEBUG validating counter group 0x7f75679e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095506319 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095506319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095506319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095506319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095506322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095506322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095506322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095506322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:07.262616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22540): Terminating (SIGTERM) 09:55:07.302031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22543): Terminating (SIGTERM) 09:55:07.341677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22546): Terminating (SIGTERM) 09:55:07.381353 --- ParallelTerminationStrategy: PID 22540 died... 09:55:07.400242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22540): Terminated: ok {rc=0} 09:55:07.445433 --- ParallelTerminationStrategy: PID 22543 died... 09:55:07.464056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22543): Terminated: ok {rc=0} 09:55:07.507924 --- ParallelTerminationStrategy: PID 22546 died... 09:55:07.526391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22546): Terminated: ok {rc=0} 09:55:07.611976 bus /sierra_3: Setting Powered False 09:55:08.709671 bus /sierra_3: Setting Powered False 09:55:09.824653 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:55:10.970230 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:10.982031 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:55:11.038777 tst mo_mt_call_osmux.py: using LAC 20657 09:55:11.157605 tst mo_mt_call_osmux.py: using RAC 2 09:55:11.275203 tst mo_mt_call_osmux.py: using CellId 20657 09:55:11.394684 tst mo_mt_call_osmux.py: using BVCI 20658 09:55:11.505681 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:11.516644 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:11.527466 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:11.538448 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:11.549672 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:55:11.560660 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:55:11.677350 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:55:11.792634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:12.294102 run create_hlr_db(pid=22550): Launched 09:55:12.417671 bus /sierra_2: Setting Powered False 09:55:13.481137 run create_hlr_db(pid=22550): Terminated: ok {rc=0} 09:55:13.908837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22552): Launched 09:55:14.232902 run osmo-hlr_10.42.42.2(pid=22553): Launched 09:55:14.357978 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:14.914836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22555): Launched 09:55:15.236808 run osmo-stp_10.42.42.5(pid=22556): Launched 09:55:15.353539 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:15.917336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22558): Launched 09:55:16.251637 run osmo-msc_10.42.42.6(pid=22559): Launched 09:55:16.717932 run osmo-stp_10.42.42.5(pid=22556): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22556)] 09:55:17.061545 run osmo-stp_10.42.42.5(pid=22556): stdout: | (launched: 2022-12-09_09:55:15.178245) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:17.189580 run osmo-stp_10.42.42.5(pid=22556): stderr: | 20221209095515346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095515346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095515346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095515347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095515347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095515347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095515347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:17.318622 run osmo-stp_10.42.42.5(pid=22556): stdout: | (launched: 2022-12-09_09:55:15.178245) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:17.439249 run osmo-stp_10.42.42.5(pid=22556): stderr: | 20221209095515346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095515346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095515346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095515347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095515347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095515347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095515347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:17.582620 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22556): Process ended prematurely: osmo-stp_10.42.42.5(pid=22556) [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22556)] [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:55:17.591539 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 09:55:17.617993 run osmo-hlr_10.42.42.2(pid=22553): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22553)] 09:55:17.665991 run osmo-hlr_10.42.42.2(pid=22553): stdout: | (launched: 2022-12-09_09:55:14.173766) 09:55:17.715880 run osmo-hlr_10.42.42.2(pid=22553): stderr: | 20221209095514368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095514369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095514369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095514369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095514369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095514369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095514380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095514390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095514390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095514390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:17.784845 run osmo-msc_10.42.42.6(pid=22559): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22559)] 09:55:17.832586 run osmo-msc_10.42.42.6(pid=22559): stdout: | (launched: 2022-12-09_09:55:16.182959) 09:55:17.881916 run osmo-msc_10.42.42.6(pid=22559): stderr: | 20221209095516584 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095516584 DLGLOBAL DEBUG validating counter group 0x7f182981ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095516584 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095516584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095516585 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095516585 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095516589 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095516590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095516591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095516597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:17.931479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22552): Terminating (SIGTERM) 09:55:17.971175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22555): Terminating (SIGTERM) 09:55:18.010916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22558): Terminating (SIGTERM) 09:55:18.050760 --- ParallelTerminationStrategy: PID 22552 died... 09:55:18.069927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22552): Terminated: ok {rc=0} 09:55:18.114175 --- ParallelTerminationStrategy: PID 22555 died... 09:55:18.132853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22555): Terminated: ok {rc=0} 09:55:18.176526 --- ParallelTerminationStrategy: PID 22558 died... 09:55:18.195291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22558): Terminated: ok {rc=0} 09:55:18.280588 bus /sierra_3: Setting Powered False 09:55:19.383367 bus /sierra_3: Setting Powered False 09:55:20.499025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:55:21.730174 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:21.735551 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:55:21.755949 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:55:21.783907 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:55:21.836009 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:55:21.857279 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:55:21.883352 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:55:22.429502 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:55:22.479398 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:22.490201 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:55:22.551262 tst mo_mt_call.py: using LAC 20658 09:55:22.670022 tst mo_mt_call.py: using RAC 3 09:55:22.788424 tst mo_mt_call.py: using CellId 20658 09:55:22.905783 tst mo_mt_call.py: using BVCI 20659 09:55:23.013690 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:23.024350 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:23.034861 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:23.045335 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:23.055790 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:23.066338 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:55:23.179306 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:55:23.298355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:23.799300 run create_hlr_db(pid=22566): Launched 09:55:23.923283 bus /sierra_2: Setting Powered False 09:55:24.987119 run create_hlr_db(pid=22566): Terminated: ok {rc=0} 09:55:25.416021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22568): Launched 09:55:25.714451 run osmo-hlr_10.42.42.2(pid=22569): Launched 09:55:25.827574 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:26.345740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22571): Launched 09:55:26.645657 run osmo-stp_10.42.42.5(pid=22572): Launched 09:55:26.761220 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:27.306119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22574): Launched 09:55:27.604755 run osmo-msc_10.42.42.6(pid=22575): Launched 09:55:27.771904 run osmo-stp_10.42.42.5(pid=22572): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22572)] 09:55:27.898980 run osmo-stp_10.42.42.5(pid=22572): stdout: | (launched: 2022-12-09_09:55:26.590027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:28.028275 run osmo-stp_10.42.42.5(pid=22572): stderr: | 20221209095526756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095526756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095526756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095526757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095526757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095526757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095526757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:28.153212 run osmo-stp_10.42.42.5(pid=22572): stdout: | (launched: 2022-12-09_09:55:26.590027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:28.272913 run osmo-stp_10.42.42.5(pid=22572): stderr: | 20221209095526756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095526756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095526756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095526757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095526757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095526757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095526757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:28.415852 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22572): Process ended prematurely: osmo-stp_10.42.42.5(pid=22572) [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22572)] [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:55:28.424814 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:55:28.451192 run osmo-hlr_10.42.42.2(pid=22569): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22569)] 09:55:28.498998 run osmo-hlr_10.42.42.2(pid=22569): stdout: | (launched: 2022-12-09_09:55:25.660164) 09:55:28.548471 run osmo-hlr_10.42.42.2(pid=22569): stderr: | 20221209095525832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095525832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095525832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095525832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095525832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095525832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095525844 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095525853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095525853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095525853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:28.617627 run osmo-msc_10.42.42.6(pid=22575): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22575)] 09:55:28.665686 run osmo-msc_10.42.42.6(pid=22575): stdout: | (launched: 2022-12-09_09:55:27.549848) 09:55:28.715009 run osmo-msc_10.42.42.6(pid=22575): stderr: | 20221209095527819 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095527819 DLGLOBAL DEBUG validating counter group 0x7f035bdfdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095527820 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095527820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095527820 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095527820 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095527823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095527823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095527823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095527823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:28.764559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22568): Terminating (SIGTERM) 09:55:28.804347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22571): Terminating (SIGTERM) 09:55:28.844309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22574): Terminating (SIGTERM) 09:55:28.884550 --- ParallelTerminationStrategy: PID 22568 died... 09:55:28.903815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22568): Terminated: ok {rc=0} 09:55:28.948216 --- ParallelTerminationStrategy: PID 22571 died... 09:55:28.966927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22571): Terminated: ok {rc=0} 09:55:29.010940 --- ParallelTerminationStrategy: PID 22574 died... 09:55:29.029662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22574): Terminated: ok {rc=0} 09:55:29.114789 bus /sierra_3: Setting Powered False 09:55:30.213916 bus /sierra_3: Setting Powered False 09:55:31.331833 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:55:32.491038 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:32.502678 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:55:32.565414 tst mo_mt_call_osmux.py: using LAC 20659 09:55:32.684027 tst mo_mt_call_osmux.py: using RAC 4 09:55:32.800579 tst mo_mt_call_osmux.py: using CellId 20659 09:55:32.917155 tst mo_mt_call_osmux.py: using BVCI 20660 09:55:33.026148 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:33.037670 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:33.048331 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:33.059178 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:33.069968 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:55:33.080626 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:55:33.194996 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:55:33.315975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:33.816533 run create_hlr_db(pid=22577): Launched 09:55:33.939330 bus /sierra_2: Setting Powered False 09:55:35.003072 run create_hlr_db(pid=22577): Terminated: ok {rc=0} 09:55:35.450646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22579): Launched 09:55:35.772165 run osmo-hlr_10.42.42.2(pid=22580): Launched 09:55:35.895356 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:36.455359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22582): Launched 09:55:36.777207 run osmo-stp_10.42.42.5(pid=22583): Launched 09:55:36.900802 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:37.484795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22585): Launched 09:55:37.806627 run osmo-msc_10.42.42.6(pid=22586): Launched 09:55:37.986608 run osmo-stp_10.42.42.5(pid=22583): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22583)] 09:55:38.122184 run osmo-stp_10.42.42.5(pid=22583): stdout: | (launched: 2022-12-09_09:55:36.718708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:38.259992 run osmo-stp_10.42.42.5(pid=22583): stderr: | 20221209095536907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095536907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095536908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095536908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095536909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095536909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095536909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:38.395389 run osmo-stp_10.42.42.5(pid=22583): stdout: | (launched: 2022-12-09_09:55:36.718708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:38.524056 run osmo-stp_10.42.42.5(pid=22583): stderr: | 20221209095536907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095536907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095536908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095536908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095536909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095536909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095536909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:38.677800 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22583): Process ended prematurely: osmo-stp_10.42.42.5(pid=22583) [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22583)] [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:55:38.687244 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:55:38.715489 run osmo-hlr_10.42.42.2(pid=22580): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22580)] 09:55:38.766284 run osmo-hlr_10.42.42.2(pid=22580): stdout: | (launched: 2022-12-09_09:55:35.713799) 09:55:38.818854 run osmo-hlr_10.42.42.2(pid=22580): stderr: | 20221209095535909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095535909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095535909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095535909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095535909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095535909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095535921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095535930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095535930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095535930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:38.891649 run osmo-msc_10.42.42.6(pid=22586): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22586)] 09:55:38.942349 run osmo-msc_10.42.42.6(pid=22586): stdout: | (launched: 2022-12-09_09:55:37.748117) 09:55:38.994652 run osmo-msc_10.42.42.6(pid=22586): stderr: | 20221209095538065 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095538065 DLGLOBAL DEBUG validating counter group 0x7f3c6d802c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095538065 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095538065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095538065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095538066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095538067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095538068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095538068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095538068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:39.047265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22579): Terminating (SIGTERM) 09:55:39.089447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22582): Terminating (SIGTERM) 09:55:39.131678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22585): Terminating (SIGTERM) 09:55:39.174147 --- ParallelTerminationStrategy: PID 22579 died... 09:55:39.194078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22579): Terminated: ok {rc=0} 09:55:39.241016 --- ParallelTerminationStrategy: PID 22582 died... 09:55:39.260471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22582): Terminated: ok {rc=0} 09:55:39.307155 --- ParallelTerminationStrategy: PID 22585 died... 09:55:39.326588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22585): Terminated: ok {rc=0} 09:55:39.414810 bus /sierra_3: Setting Powered False 09:55:40.513713 bus /sierra_3: Setting Powered False 09:55:41.629321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:sysmo --------------------------------------------------------------------- 09:55:42.856623 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:42.860610 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 09:55:42.881036 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 09:55:42.907633 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 09:55:42.990867 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 09:55:43.011028 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 09:55:43.036878 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 09:55:43.622170 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 09:55:43.627676 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:43.638794 tst emergency:sysmo: Using 1 x bts (candidates: 1) 09:55:43.676706 tst emergency_mo_mt_call.py: using LAC 20660 09:55:43.802267 tst emergency_mo_mt_call.py: using RAC 5 09:55:43.926189 tst emergency_mo_mt_call.py: using CellId 20660 09:55:44.060666 tst emergency_mo_mt_call.py: using BVCI 20661 09:55:44.178506 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:44.189691 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:44.200655 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:44.212349 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:44.223744 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:44.235073 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:55:44.349698 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:55:44.463859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:44.920758 run create_hlr_db(pid=22591): Launched 09:55:45.042082 bus /sierra_2: Setting Powered False 09:55:46.100888 run create_hlr_db(pid=22591): Terminated: ok {rc=0} 09:55:46.550209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22593): Launched 09:55:46.887914 run osmo-hlr_10.42.42.2(pid=22594): Launched 09:55:47.034672 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:47.637842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22596): Launched 09:55:47.956434 run osmo-stp_10.42.42.5(pid=22597): Launched 09:55:48.088224 tst emergency_mo_mt_call.py: using MSISDN 7152 09:55:48.254855 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:48.825734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22599): Launched 09:55:49.142202 run osmo-msc_10.42.42.6(pid=22600): Launched 09:55:49.318499 run osmo-stp_10.42.42.5(pid=22597): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22597)] 09:55:49.453108 run osmo-stp_10.42.42.5(pid=22597): stdout: | (launched: 2022-12-09_09:55:47.897933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:49.587758 run osmo-stp_10.42.42.5(pid=22597): stderr: | 20221209095548087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095548087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095548087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095548088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095548088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095548088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095548089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:49.714320 run osmo-stp_10.42.42.5(pid=22597): stdout: | (launched: 2022-12-09_09:55:47.897933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:49.831815 run osmo-stp_10.42.42.5(pid=22597): stderr: | 20221209095548087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095548087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095548087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095548088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095548088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095548088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095548089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:49.972196 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22597): Process ended prematurely: osmo-stp_10.42.42.5(pid=22597) [trial-2358↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22597)] [trial-2358↪emergency:sysmo↪emergency_mo_mt_call.py:19] 09:55:49.980655 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 09:55:50.006872 run osmo-hlr_10.42.42.2(pid=22594): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22594)] 09:55:50.055717 run osmo-hlr_10.42.42.2(pid=22594): stdout: | (launched: 2022-12-09_09:55:46.825165) 09:55:50.106077 run osmo-hlr_10.42.42.2(pid=22594): stderr: | 20221209095547202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095547202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095547202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095547202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095547202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095547202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095547227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095547235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095547236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095547236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:50.175974 run osmo-msc_10.42.42.6(pid=22600): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22600)] 09:55:50.225062 run osmo-msc_10.42.42.6(pid=22600): stdout: | (launched: 2022-12-09_09:55:49.084357) 09:55:50.275382 run osmo-msc_10.42.42.6(pid=22600): stderr: | 20221209095549402 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095549402 DLGLOBAL DEBUG validating counter group 0x7f62b386dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095549402 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095549402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095549402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095549402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095549404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095549405 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095549405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095549405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:50.325941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22593): Terminating (SIGTERM) 09:55:50.366282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22596): Terminating (SIGTERM) 09:55:50.406739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22599): Terminating (SIGTERM) 09:55:50.447135 --- ParallelTerminationStrategy: PID 22593 died... 09:55:50.466315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22593): Terminated: ok {rc=0} 09:55:50.511001 --- ParallelTerminationStrategy: PID 22596 died... 09:55:50.530023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22596): Terminated: ok {rc=0} 09:55:50.575007 --- ParallelTerminationStrategy: PID 22599 died... 09:55:50.593946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22599): Terminated: ok {rc=0} 09:55:50.680163 bus /sierra_3: Setting Powered False 09:55:51.780668 bus /sierra_3: Setting Powered False 09:55:52.896530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 09:55:53.985253 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:53.996424 tst emergency:sysmo: Using 1 x bts (candidates: 1) 09:55:54.038449 tst emergency_preemptive_call.py: using LAC 20661 09:55:54.156464 tst emergency_preemptive_call.py: using RAC 6 09:55:54.280882 tst emergency_preemptive_call.py: using CellId 20661 09:55:54.404359 tst emergency_preemptive_call.py: using BVCI 20662 09:55:54.519580 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:54.530817 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:54.541683 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:54.552870 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:54.563998 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:55:54.575026 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:55:54.689085 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:55:54.807852 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:55:54.921598 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:55:55.037152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:55.527792 run create_hlr_db(pid=22602): Launched 09:55:55.648275 bus /sierra_2: Setting Powered False 09:55:56.711290 run create_hlr_db(pid=22602): Terminated: ok {rc=0} 09:55:57.133704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22604): Launched 09:55:57.428541 run osmo-hlr_10.42.42.2(pid=22605): Launched 09:55:57.541574 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:58.049372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22607): Launched 09:55:58.345729 run osmo-stp_10.42.42.5(pid=22608): Launched 09:55:58.468406 tst emergency_preemptive_call.py: using MSISDN 7153 09:55:58.628060 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:59.156740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22610): Launched 09:55:59.449914 run osmo-msc_10.42.42.6(pid=22611): Launched 09:55:59.620177 run osmo-stp_10.42.42.5(pid=22608): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22608)] 09:55:59.744283 run osmo-stp_10.42.42.5(pid=22608): stdout: | (launched: 2022-12-09_09:55:58.291041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:59.868396 run osmo-stp_10.42.42.5(pid=22608): stderr: | 20221209095558459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095558459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095558459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095558460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095558461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095558461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095558461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:59.990819 run osmo-stp_10.42.42.5(pid=22608): stdout: | (launched: 2022-12-09_09:55:58.291041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:00.107471 run osmo-stp_10.42.42.5(pid=22608): stderr: | 20221209095558459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095558459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095558459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095558460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095558461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095558461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095558461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:00.247285 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22608): Process ended prematurely: osmo-stp_10.42.42.5(pid=22608) [trial-2358↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22608)] [trial-2358↪emergency:sysmo↪emergency_preemptive_call.py:32] 09:56:00.255546 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 09:56:00.281228 run osmo-hlr_10.42.42.2(pid=22605): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22605)] 09:56:00.328443 run osmo-hlr_10.42.42.2(pid=22605): stdout: | (launched: 2022-12-09_09:55:57.374326) 09:56:00.377470 run osmo-hlr_10.42.42.2(pid=22605): stderr: | 20221209095557545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095557545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095557545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095557545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095557545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095557545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095557558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095557568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095557568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095557568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:00.445819 run osmo-msc_10.42.42.6(pid=22611): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22611)] 09:56:00.492913 run osmo-msc_10.42.42.6(pid=22611): stdout: | (launched: 2022-12-09_09:55:59.395650) 09:56:00.541759 run osmo-msc_10.42.42.6(pid=22611): stderr: | 20221209095559661 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209095559661 DLGLOBAL DEBUG validating counter group 0x7ff21c387c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209095559662 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209095559662 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209095559662 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209095559662 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209095559664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209095559665 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209095559665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209095559665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:00.590971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22604): Terminating (SIGTERM) 09:56:00.630035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22607): Terminating (SIGTERM) 09:56:00.669191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22610): Terminating (SIGTERM) 09:56:00.708526 --- ParallelTerminationStrategy: PID 22604 died... 09:56:00.727273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22604): Terminated: ok {rc=0} 09:56:00.770388 --- ParallelTerminationStrategy: PID 22607 died... 09:56:00.788687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22607): Terminated: ok {rc=0} 09:56:00.832165 --- ParallelTerminationStrategy: PID 22610 died... 09:56:00.850661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22610): Terminated: ok {rc=0} 09:56:00.942501 bus /sierra_9: Setting Powered False 09:56:02.050759 bus /sierra_9: Setting Powered False 09:56:03.170592 bus /sierra_8: Setting Powered False 09:56:04.267887 bus /sierra_8: Setting Powered False 09:56:05.384652 bus /sierra_3: Setting Powered False 09:56:06.482110 bus /sierra_3: Setting Powered False 09:56:07.598359 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:sysmo --------------------------------------------------------------------- 09:56:08.860322 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:08.864758 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 09:56:08.886594 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 09:56:08.925834 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 09:56:09.014934 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 09:56:09.035845 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 09:56:09.074844 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 09:56:09.662879 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 09:56:09.717304 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:09.728049 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:56:09.764403 tst cs_paging_gprs_active.py: using LAC 20662 09:56:09.893303 tst cs_paging_gprs_active.py: using RAC 7 09:56:10.020427 tst cs_paging_gprs_active.py: using CellId 20662 09:56:10.148630 tst cs_paging_gprs_active.py: using BVCI 20663 09:56:10.268336 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.279443 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.290470 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.301883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.313236 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.324509 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.335772 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.346591 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:10.358444 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:10.472015 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:10.590977 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:56:10.793086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:11.098196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22616): Launched 09:56:11.358857 run iperf3-srv_10.42.42.10(pid=22617): Launched 09:56:11.471229 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:56:11.671155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:11.971748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22618): Launched 09:56:12.232660 run iperf3-srv_10.42.42.10(pid=22619): Launched 09:56:12.344378 tst cs_paging_gprs_active.py:38: start network... 09:56:12.543307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:13.008474 run create_hlr_db(pid=22620): Launched 09:56:13.132157 bus /sierra_2: Setting Powered False 09:56:14.192581 run create_hlr_db(pid=22620): Terminated: ok {rc=0} 09:56:14.632307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22622): Launched 09:56:14.955980 run osmo-hlr_10.42.42.2(pid=22623): Launched 09:56:15.079702 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:15.636588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22625): Launched 09:56:15.996356 run osmo-stp_10.42.42.5(pid=22626): Launched 09:56:16.247059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:17.863600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22628): Launched 09:56:17.978359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:18.231974 run patchelf(pid=22629): Launched 09:56:18.399771 run osmo-stp_10.42.42.5(pid=22626): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22626)] 09:56:18.526347 run osmo-stp_10.42.42.5(pid=22626): stdout: | (launched: 2022-12-09_09:56:15.919914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:18.654790 run osmo-stp_10.42.42.5(pid=22626): stderr: | 20221209095616292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095616292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095616292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095616303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095616304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095616304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095616304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:18.783332 run osmo-stp_10.42.42.5(pid=22626): stdout: | (launched: 2022-12-09_09:56:15.919914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:18.907039 run osmo-stp_10.42.42.5(pid=22626): stderr: | 20221209095616292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095616292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095616292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095616303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095616304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095616304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095616304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:19.054135 run patchelf(pid=22629): Terminating (SIGINT) 09:56:19.223245 run patchelf(pid=22629): Terminated: ok {rc=0} 09:56:19.344700 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22626): Process ended prematurely: osmo-stp_10.42.42.5(pid=22626) [trial-2358↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22626)] [trial-2358↪gprs:sysmo↪cs_paging_gprs_active.py:38] 09:56:19.354161 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 09:56:19.381122 run osmo-hlr_10.42.42.2(pid=22623): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22623)] 09:56:19.428292 run osmo-hlr_10.42.42.2(pid=22623): stdout: | (launched: 2022-12-09_09:56:14.896860) 09:56:19.477252 run osmo-hlr_10.42.42.2(pid=22623): stderr: | 20221209095615090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095615090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095615090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095615090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095615090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095615091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095615102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095615111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095615112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095615112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:19.526541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22616): Terminating (SIGTERM) 09:56:19.566095 run iperf3-srv_10.42.42.10(pid=22617): Terminating (SIGTERM) 09:56:19.605504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22618): Terminating (SIGTERM) 09:56:19.644915 run iperf3-srv_10.42.42.10(pid=22619): Terminating (SIGTERM) 09:56:19.684065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22622): Terminating (SIGTERM) 09:56:19.723471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22625): Terminating (SIGTERM) 09:56:19.762709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22628): Terminating (SIGTERM) 09:56:19.802386 --- ParallelTerminationStrategy: PID 22616 died... 09:56:19.821462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22616): Terminated: ok {rc=0} 09:56:19.865331 --- ParallelTerminationStrategy: PID 22617 died... 09:56:19.883681 run iperf3-srv_10.42.42.10(pid=22617): Terminated {rc=256} 09:56:19.927609 --- ParallelTerminationStrategy: PID 22618 died... 09:56:19.946316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22618): Terminated: ok {rc=0} 09:56:19.990134 --- ParallelTerminationStrategy: PID 22619 died... 09:56:20.008558 run iperf3-srv_10.42.42.10(pid=22619): Terminated {rc=256} 09:56:20.052279 --- ParallelTerminationStrategy: PID 22622 died... 09:56:20.070909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22622): Terminated: ok {rc=0} 09:56:20.115279 --- ParallelTerminationStrategy: PID 22625 died... 09:56:20.133933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22625): Terminated: ok {rc=0} 09:56:20.177570 --- ParallelTerminationStrategy: PID 22628 died... 09:56:20.196170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22628): Terminated: ok {rc=0} 09:56:20.282353 bus /gobi_0: Setting Powered False 09:56:21.381967 bus /gobi_0: Setting Powered False 09:56:22.494313 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo iperf3.py ---------------------------------------------- 09:56:23.643139 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:23.654861 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:56:23.695628 tst iperf3.py: using LAC 20663 09:56:23.823376 tst iperf3.py: using RAC 8 09:56:23.949140 tst iperf3.py: using CellId 20663 09:56:24.075185 tst iperf3.py: using BVCI 20664 09:56:24.194720 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.205690 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.216338 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.227434 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.238435 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.249444 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.260375 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.271340 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:24.282468 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:24.399940 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:56:24.618417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:24.942860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22630): Launched 09:56:25.225546 run iperf3-srv_10.42.42.10(pid=22631): Launched 09:56:25.346809 tst iperf3.py:8: start network... 09:56:25.564791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:26.068321 run create_hlr_db(pid=22632): Launched 09:56:26.191025 bus /gobi_6: Setting Powered False 09:56:27.254445 run create_hlr_db(pid=22632): Terminated: ok {rc=0} 09:56:27.685459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22634): Launched 09:56:27.987307 run osmo-hlr_10.42.42.2(pid=22635): Launched 09:56:28.101122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:28.622460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22637): Launched 09:56:28.920933 run osmo-stp_10.42.42.5(pid=22638): Launched 09:56:29.034819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:29.551810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22640): Launched 09:56:29.665868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:29.919070 run patchelf(pid=22641): Launched 09:56:30.085331 run osmo-stp_10.42.42.5(pid=22638): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22638)] 09:56:30.212372 run osmo-stp_10.42.42.5(pid=22638): stdout: | (launched: 2022-12-09_09:56:28.865512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:30.340642 run osmo-stp_10.42.42.5(pid=22638): stderr: | 20221209095629033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095629033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095629033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095629034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095629034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095629034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095629034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:30.469355 run osmo-stp_10.42.42.5(pid=22638): stdout: | (launched: 2022-12-09_09:56:28.865512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:30.592367 run osmo-stp_10.42.42.5(pid=22638): stderr: | 20221209095629033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095629033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095629033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095629034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095629034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095629034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095629034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:30.738546 run patchelf(pid=22641): Terminating (SIGINT) 09:56:30.915449 run patchelf(pid=22641): Terminated: ok {rc=0} 09:56:31.039357 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22638): Process ended prematurely: osmo-stp_10.42.42.5(pid=22638) [trial-2358↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22638)] [trial-2358↪gprs:sysmo↪iperf3.py:8] 09:56:31.049498 tst iperf3.py:8: Test FAILED (7.4 sec) 09:56:31.077495 run osmo-hlr_10.42.42.2(pid=22635): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22635)] 09:56:31.127032 run osmo-hlr_10.42.42.2(pid=22635): stdout: | (launched: 2022-12-09_09:56:27.931462) 09:56:31.178121 run osmo-hlr_10.42.42.2(pid=22635): stderr: | 20221209095628106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095628106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095628106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095628106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095628106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095628106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095628118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095628127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095628127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095628127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:31.229434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22630): Terminating (SIGTERM) 09:56:31.271022 run iperf3-srv_10.42.42.10(pid=22631): Terminating (SIGTERM) 09:56:31.315406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22634): Terminating (SIGTERM) 09:56:31.357382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22637): Terminating (SIGTERM) 09:56:31.400939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22640): Terminating (SIGTERM) 09:56:31.443357 --- ParallelTerminationStrategy: PID 22630 died... 09:56:31.463000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22630): Terminated: ok {rc=0} 09:56:31.509448 --- ParallelTerminationStrategy: PID 22631 died... 09:56:31.528574 run iperf3-srv_10.42.42.10(pid=22631): Terminated {rc=256} 09:56:31.574109 --- ParallelTerminationStrategy: PID 22634 died... 09:56:31.593313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22634): Terminated: ok {rc=0} 09:56:31.638980 --- ParallelTerminationStrategy: PID 22637 died... 09:56:31.658298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22637): Terminated: ok {rc=0} 09:56:31.703979 --- ParallelTerminationStrategy: PID 22640 died... 09:56:31.723816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22640): Terminated: ok {rc=0} 09:56:31.812453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo iperf3m4.py ---------------------------------------------- 09:56:32.960860 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:32.972327 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:56:33.009026 tst iperf3m4.py: using LAC 20664 09:56:33.129188 tst iperf3m4.py: using RAC 9 09:56:33.250815 tst iperf3m4.py: using CellId 20664 09:56:33.369380 tst iperf3m4.py: using BVCI 20665 09:56:33.480716 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.491432 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.502031 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.512597 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.523073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.533404 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.543922 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.554298 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:33.564765 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:33.684429 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:33.803169 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:33.922053 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:34.041627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:56:34.260220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:34.586329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Launched 09:56:34.875601 run iperf3-srv_10.42.42.10(pid=22643): Launched 09:56:34.997595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:56:35.215372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:35.540167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22644): Launched 09:56:35.821359 run iperf3-srv_10.42.42.10(pid=22645): Launched 09:56:35.942635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:56:36.160838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:36.485690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22646): Launched 09:56:36.766160 run iperf3-srv_10.42.42.10(pid=22647): Launched 09:56:36.886863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:56:37.103622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:37.428164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22648): Launched 09:56:37.724838 run iperf3-srv_10.42.42.10(pid=22649): Launched 09:56:37.837747 tst iperf3m4.py:8: start network... 09:56:38.037766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:38.504621 run create_hlr_db(pid=22650): Launched 09:56:38.626982 bus /gobi_6: Setting Powered False 09:56:39.687081 run create_hlr_db(pid=22650): Terminated: ok {rc=0} 09:56:40.107284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22652): Launched 09:56:40.407963 run osmo-hlr_10.42.42.2(pid=22653): Launched 09:56:40.521083 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:41.053189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Launched 09:56:41.353809 run osmo-stp_10.42.42.5(pid=22656): Launched 09:56:41.468739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:41.989594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22658): Launched 09:56:42.104804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:42.360534 run patchelf(pid=22659): Launched 09:56:42.527776 run osmo-stp_10.42.42.5(pid=22656): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22656)] 09:56:42.654993 run osmo-stp_10.42.42.5(pid=22656): stdout: | (launched: 2022-12-09_09:56:41.298327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:42.783776 run osmo-stp_10.42.42.5(pid=22656): stderr: | 20221209095641464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095641464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095641464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095641465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095641465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095641465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095641466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:42.912632 run osmo-stp_10.42.42.5(pid=22656): stdout: | (launched: 2022-12-09_09:56:41.298327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:43.036351 run osmo-stp_10.42.42.5(pid=22656): stderr: | 20221209095641464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095641464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095641464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095641465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095641465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095641465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095641466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:43.182683 run patchelf(pid=22659): Terminating (SIGINT) 09:56:43.351862 run patchelf(pid=22659): Terminated: ok {rc=0} 09:56:43.473164 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22656): Process ended prematurely: osmo-stp_10.42.42.5(pid=22656) [trial-2358↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22656)] [trial-2358↪gprs:sysmo↪iperf3m4.py:8] 09:56:43.482700 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:56:43.509951 run osmo-hlr_10.42.42.2(pid=22653): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22653)] 09:56:43.557979 run osmo-hlr_10.42.42.2(pid=22653): stdout: | (launched: 2022-12-09_09:56:40.352148) 09:56:43.607648 run osmo-hlr_10.42.42.2(pid=22653): stderr: | 20221209095640526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095640526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095640526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095640526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095640526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095640526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095640538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095640547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095640548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095640548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:43.657865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Terminating (SIGTERM) 09:56:43.697880 run iperf3-srv_10.42.42.10(pid=22643): Terminating (SIGTERM) 09:56:43.737960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22644): Terminating (SIGTERM) 09:56:43.778072 run iperf3-srv_10.42.42.10(pid=22645): Terminating (SIGTERM) 09:56:43.818107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22646): Terminating (SIGTERM) 09:56:43.858191 run iperf3-srv_10.42.42.10(pid=22647): Terminating (SIGTERM) 09:56:43.898321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22648): Terminating (SIGTERM) 09:56:43.938472 run iperf3-srv_10.42.42.10(pid=22649): Terminating (SIGTERM) 09:56:43.978466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22652): Terminating (SIGTERM) 09:56:44.018647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Terminating (SIGTERM) 09:56:44.058897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22658): Terminating (SIGTERM) 09:56:44.099379 --- ParallelTerminationStrategy: PID 22642 died... 09:56:44.118653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Terminated: ok {rc=0} 09:56:44.163031 --- ParallelTerminationStrategy: PID 22643 died... 09:56:44.181849 run iperf3-srv_10.42.42.10(pid=22643): Terminated {rc=256} 09:56:44.226044 --- ParallelTerminationStrategy: PID 22644 died... 09:56:44.244879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22644): Terminated: ok {rc=0} 09:56:44.289175 --- ParallelTerminationStrategy: PID 22645 died... 09:56:44.307848 run iperf3-srv_10.42.42.10(pid=22645): Terminated {rc=256} 09:56:44.352299 --- ParallelTerminationStrategy: PID 22646 died... 09:56:44.370998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22646): Terminated: ok {rc=0} 09:56:44.415226 --- ParallelTerminationStrategy: PID 22647 died... 09:56:44.433868 run iperf3-srv_10.42.42.10(pid=22647): Terminated {rc=256} 09:56:44.477997 --- ParallelTerminationStrategy: PID 22648 died... 09:56:44.496599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22648): Terminated: ok {rc=0} 09:56:44.541250 --- ParallelTerminationStrategy: PID 22649 died... 09:56:44.559955 run iperf3-srv_10.42.42.10(pid=22649): Terminated {rc=256} 09:56:44.604326 --- ParallelTerminationStrategy: PID 22652 died... 09:56:44.623016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22652): Terminated: ok {rc=0} 09:56:44.667008 --- ParallelTerminationStrategy: PID 22655 died... 09:56:44.685711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Terminated: ok {rc=0} 09:56:44.730161 --- ParallelTerminationStrategy: PID 22658 died... 09:56:44.748628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22658): Terminated: ok {rc=0} 09:56:44.833249 bus /gobi_4: Setting Powered False 09:56:45.939044 bus /gobi_4: Setting Powered False 09:56:47.062552 bus /gobi_1: Setting Powered False 09:56:48.168753 bus /gobi_1: Setting Powered False 09:56:49.284738 bus /gobi_0: Setting Powered False 09:56:50.384688 bus /gobi_0: Setting Powered False 09:56:51.501049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo ping.py ---------------------------------------------- 09:56:52.608288 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:52.620083 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:56:52.657256 tst ping.py: using LAC 20665 09:56:52.784210 tst ping.py: using RAC 10 09:56:52.909961 tst ping.py: using CellId 20665 09:56:53.037567 tst ping.py: using BVCI 20666 09:56:53.155662 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.166803 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.177887 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.189078 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.200077 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.211233 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.222556 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:56:53.233827 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:56:53.352261 tst ping.py:19: start network... 09:56:53.565485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:54.059251 run create_hlr_db(pid=22661): Launched 09:56:54.179726 bus /gobi_6: Setting Powered False 09:56:55.242534 run create_hlr_db(pid=22661): Terminated: ok {rc=0} 09:56:55.686686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22663): Launched 09:56:56.005896 run osmo-hlr_10.42.42.2(pid=22664): Launched 09:56:56.128502 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:56.671860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22666): Launched 09:56:56.988236 run osmo-stp_10.42.42.5(pid=22667): Launched 09:56:57.110190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:57.659599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22669): Launched 09:56:57.782431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:58.051468 run patchelf(pid=22670): Launched 09:56:58.229662 run osmo-stp_10.42.42.5(pid=22667): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22667)] 09:56:58.364826 run osmo-stp_10.42.42.5(pid=22667): stdout: | (launched: 2022-12-09_09:56:56.929940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:58.501197 run osmo-stp_10.42.42.5(pid=22667): stderr: | 20221209095657119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095657119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095657119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095657120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095657120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095657120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095657120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:58.637822 run osmo-stp_10.42.42.5(pid=22667): stdout: | (launched: 2022-12-09_09:56:56.929940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:58.768571 run osmo-stp_10.42.42.5(pid=22667): stderr: | 20221209095657119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095657119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095657119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095657120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095657120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095657120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095657120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:58.923372 run patchelf(pid=22670): Terminating (SIGINT) 09:56:59.101657 run patchelf(pid=22670): Terminated: ok {rc=0} 09:56:59.230019 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22667): Process ended prematurely: osmo-stp_10.42.42.5(pid=22667) [trial-2358↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22667)] [trial-2358↪gprs:sysmo↪ping.py:22] 09:56:59.239518 tst ping.py:22: Test FAILED (6.6 sec) 09:56:59.268094 run osmo-hlr_10.42.42.2(pid=22664): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22664)] 09:56:59.318992 run osmo-hlr_10.42.42.2(pid=22664): stdout: | (launched: 2022-12-09_09:56:55.947461) 09:56:59.371896 run osmo-hlr_10.42.42.2(pid=22664): stderr: | 20221209095656144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095656144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095656144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095656145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095656145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095656145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095656157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095656165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095656166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095656166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:59.425052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22663): Terminating (SIGTERM) 09:56:59.467543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22666): Terminating (SIGTERM) 09:56:59.510030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22669): Terminating (SIGTERM) 09:56:59.552822 --- ParallelTerminationStrategy: PID 22663 died... 09:56:59.573040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22663): Terminated: ok {rc=0} 09:56:59.620515 --- ParallelTerminationStrategy: PID 22666 died... 09:56:59.640444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22666): Terminated: ok {rc=0} 09:56:59.687656 --- ParallelTerminationStrategy: PID 22669 died... 09:56:59.707506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22669): Terminated: ok {rc=0} 09:56:59.797076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 09:57:00.888854 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:00.900514 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:57:00.948579 tst ping_idle_ping.py: using LAC 20666 09:57:01.069468 tst ping_idle_ping.py: using RAC 11 09:57:01.201363 tst ping_idle_ping.py: using CellId 20666 09:57:01.332765 tst ping_idle_ping.py: using BVCI 20667 09:57:01.448085 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.459164 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.470257 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.481297 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.492093 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.503039 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.514246 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:57:01.525738 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:57:01.654081 tst ping_idle_ping.py:24: start network... 09:57:01.923142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:02.415269 run create_hlr_db(pid=22671): Launched 09:57:02.535097 bus /gobi_6: Setting Powered False 09:57:03.594326 run create_hlr_db(pid=22671): Terminated: ok {rc=0} 09:57:04.007653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22673): Launched 09:57:04.302286 run osmo-hlr_10.42.42.2(pid=22674): Launched 09:57:04.413988 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:04.933846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22676): Launched 09:57:05.229164 run osmo-stp_10.42.42.5(pid=22677): Launched 09:57:05.341103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:05.854101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22679): Launched 09:57:05.967081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:06.216758 run patchelf(pid=22680): Launched 09:57:06.381296 run osmo-stp_10.42.42.5(pid=22677): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22677)] 09:57:06.506832 run osmo-stp_10.42.42.5(pid=22677): stdout: | (launched: 2022-12-09_09:57:05.174380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:06.633922 run osmo-stp_10.42.42.5(pid=22677): stderr: | 20221209095705345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095705345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095705346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095705346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095705346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095705347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095705347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:06.761168 run osmo-stp_10.42.42.5(pid=22677): stdout: | (launched: 2022-12-09_09:57:05.174380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:06.882747 run osmo-stp_10.42.42.5(pid=22677): stderr: | 20221209095705345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095705345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095705346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095705346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095705346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095705347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095705347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:07.026665 run patchelf(pid=22680): Terminating (SIGINT) 09:57:07.192623 run patchelf(pid=22680): Terminated: ok {rc=0} 09:57:07.312071 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22677): Process ended prematurely: osmo-stp_10.42.42.5(pid=22677) [trial-2358↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22677)] [trial-2358↪gprs:sysmo↪ping_idle_ping.py:27] 09:57:07.320880 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:57:07.347268 run osmo-hlr_10.42.42.2(pid=22674): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22674)] 09:57:07.394739 run osmo-hlr_10.42.42.2(pid=22674): stdout: | (launched: 2022-12-09_09:57:04.247395) 09:57:07.444440 run osmo-hlr_10.42.42.2(pid=22674): stderr: | 20221209095704423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095704423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095704423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095704423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095704423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095704424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095704436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095704444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095704445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095704445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:07.494976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22673): Terminating (SIGTERM) 09:57:07.534456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22676): Terminating (SIGTERM) 09:57:07.574085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22679): Terminating (SIGTERM) 09:57:07.613836 --- ParallelTerminationStrategy: PID 22673 died... 09:57:07.632791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22673): Terminated: ok {rc=0} 09:57:07.676549 --- ParallelTerminationStrategy: PID 22676 died... 09:57:07.695203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22676): Terminated: ok {rc=0} 09:57:07.739074 --- ParallelTerminationStrategy: PID 22679 died... 09:57:07.757637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22679): Terminated: ok {rc=0} 09:57:07.842891 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 09:57:09.124789 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:57:09.130051 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:57:09.150552 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:57:09.188314 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:57:09.274061 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:57:09.294636 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:57:09.332325 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:57:09.922281 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:57:09.970894 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:09.981718 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:57:10.018248 tst cs_paging_gprs_active.py: using LAC 20667 09:57:10.137710 tst cs_paging_gprs_active.py: using RAC 12 09:57:10.267337 tst cs_paging_gprs_active.py: using CellId 20667 09:57:10.396099 tst cs_paging_gprs_active.py: using BVCI 20668 09:57:10.514917 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.526448 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.537779 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.549663 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.560877 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.572112 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.583675 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.595235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:10.606846 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:10.725784 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:10.845439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:57:11.064736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:11.390548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22684): Launched 09:57:11.674243 run iperf3-srv_10.42.42.10(pid=22685): Launched 09:57:11.797578 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:57:12.016217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:12.341684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22686): Launched 09:57:12.623106 run iperf3-srv_10.42.42.10(pid=22687): Launched 09:57:12.746749 tst cs_paging_gprs_active.py:38: start network... 09:57:12.965253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:13.467340 run create_hlr_db(pid=22688): Launched 09:57:13.590856 bus /gobi_6: Setting Powered False 09:57:14.654544 run create_hlr_db(pid=22688): Terminated: ok {rc=0} 09:57:15.106390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Launched 09:57:15.430115 run osmo-hlr_10.42.42.2(pid=22691): Launched 09:57:15.554042 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:16.129763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Launched 09:57:16.454736 run osmo-stp_10.42.42.5(pid=22694): Launched 09:57:16.700436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:17.311326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22696): Launched 09:57:17.426395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:17.682179 run patchelf(pid=22697): Launched 09:57:17.848471 run osmo-stp_10.42.42.5(pid=22694): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] 09:57:17.975680 run osmo-stp_10.42.42.5(pid=22694): stdout: | (launched: 2022-12-09_09:57:16.397507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:18.104632 run osmo-stp_10.42.42.5(pid=22694): stderr: | 20221209095716727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095716727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095716727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095716728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095716728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095716728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095716728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:18.233505 run osmo-stp_10.42.42.5(pid=22694): stdout: | (launched: 2022-12-09_09:57:16.397507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:18.357784 run osmo-stp_10.42.42.5(pid=22694): stderr: | 20221209095716727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095716727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095716727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095716728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095716728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095716728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095716728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:18.504324 run patchelf(pid=22697): Terminating (SIGINT) 09:57:18.672740 run patchelf(pid=22697): Terminated: ok {rc=0} 09:57:18.794380 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22694): Process ended prematurely: osmo-stp_10.42.42.5(pid=22694) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] [trial-2358↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:57:18.803778 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 09:57:18.830881 run osmo-hlr_10.42.42.2(pid=22691): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22691)] 09:57:18.878524 run osmo-hlr_10.42.42.2(pid=22691): stdout: | (launched: 2022-12-09_09:57:15.370685) 09:57:18.927818 run osmo-hlr_10.42.42.2(pid=22691): stderr: | 20221209095715570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095715570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095715570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095715570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095715570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095715570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095715582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095715591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095715592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095715592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:18.977677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22684): Terminating (SIGTERM) 09:57:19.018199 run iperf3-srv_10.42.42.10(pid=22685): Terminating (SIGTERM) 09:57:19.058137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22686): Terminating (SIGTERM) 09:57:19.098207 run iperf3-srv_10.42.42.10(pid=22687): Terminating (SIGTERM) 09:57:19.138049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Terminating (SIGTERM) 09:57:19.177954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Terminating (SIGTERM) 09:57:19.218247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22696): Terminating (SIGTERM) 09:57:19.258355 --- ParallelTerminationStrategy: PID 22684 died... 09:57:19.277446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22684): Terminated: ok {rc=0} 09:57:19.321582 --- ParallelTerminationStrategy: PID 22685 died... 09:57:19.340090 run iperf3-srv_10.42.42.10(pid=22685): Terminated {rc=256} 09:57:19.383851 --- ParallelTerminationStrategy: PID 22686 died... 09:57:19.402601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22686): Terminated: ok {rc=0} 09:57:19.446044 --- ParallelTerminationStrategy: PID 22687 died... 09:57:19.464446 run iperf3-srv_10.42.42.10(pid=22687): Terminated {rc=256} 09:57:19.508120 --- ParallelTerminationStrategy: PID 22690 died... 09:57:19.526720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Terminated: ok {rc=0} 09:57:19.570305 --- ParallelTerminationStrategy: PID 22693 died... 09:57:19.588879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Terminated: ok {rc=0} 09:57:19.632640 --- ParallelTerminationStrategy: PID 22696 died... 09:57:19.651305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22696): Terminated: ok {rc=0} 09:57:19.736237 bus /gobi_0: Setting Powered False 09:57:20.835948 bus /gobi_0: Setting Powered False 09:57:21.951528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:57:23.097371 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.108542 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:57:23.145312 tst iperf3.py: using LAC 20668 09:57:23.263766 tst iperf3.py: using RAC 13 09:57:23.388342 tst iperf3.py: using CellId 20668 09:57:23.508093 tst iperf3.py: using BVCI 20669 09:57:23.617773 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.628316 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.638871 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.649394 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.659773 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.670163 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.680696 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.691094 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:23.701692 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:23.818372 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:57:24.018178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:24.318963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22698): Launched 09:57:24.579754 run iperf3-srv_10.42.42.10(pid=22699): Launched 09:57:24.691566 tst iperf3.py:8: start network... 09:57:24.890329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:25.355155 run create_hlr_db(pid=22700): Launched 09:57:25.478577 bus /gobi_6: Setting Powered False 09:57:26.539054 run create_hlr_db(pid=22700): Terminated: ok {rc=0} 09:57:26.979502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22702): Launched 09:57:27.303486 run osmo-hlr_10.42.42.2(pid=22703): Launched 09:57:27.428757 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:27.984351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22705): Launched 09:57:28.306441 run osmo-stp_10.42.42.5(pid=22706): Launched 09:57:28.431161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:28.989181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22708): Launched 09:57:29.112413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:29.385410 run patchelf(pid=22709): Launched 09:57:29.565633 run osmo-stp_10.42.42.5(pid=22706): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22706)] 09:57:29.703652 run osmo-stp_10.42.42.5(pid=22706): stdout: | (launched: 2022-12-09_09:57:28.247612) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:29.843088 run osmo-stp_10.42.42.5(pid=22706): stderr: | 20221209095728439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095728439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095728440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095728440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095728441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095728441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095728441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:29.982743 run osmo-stp_10.42.42.5(pid=22706): stdout: | (launched: 2022-12-09_09:57:28.247612) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:30.116489 run osmo-stp_10.42.42.5(pid=22706): stderr: | 20221209095728439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095728439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095728440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095728440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095728441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095728441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095728441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:30.274993 run patchelf(pid=22709): Terminating (SIGINT) 09:57:30.457201 run patchelf(pid=22709): Terminated: ok {rc=0} 09:57:30.589358 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22706): Process ended prematurely: osmo-stp_10.42.42.5(pid=22706) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22706)] [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 09:57:30.599597 tst iperf3.py:8: Test FAILED (7.5 sec) 09:57:30.628662 run osmo-hlr_10.42.42.2(pid=22703): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22703)] 09:57:30.679118 run osmo-hlr_10.42.42.2(pid=22703): stdout: | (launched: 2022-12-09_09:57:27.244111) 09:57:30.731481 run osmo-hlr_10.42.42.2(pid=22703): stderr: | 20221209095727442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095727442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095727442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095727442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095727442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095727442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095727454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095727462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095727463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095727463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:30.784207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22698): Terminating (SIGTERM) 09:57:30.828599 run iperf3-srv_10.42.42.10(pid=22699): Terminating (SIGTERM) 09:57:30.881451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22702): Terminating (SIGTERM) 09:57:30.923819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22705): Terminating (SIGTERM) 09:57:30.967056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22708): Terminating (SIGTERM) 09:57:31.012142 --- ParallelTerminationStrategy: PID 22698 died... 09:57:31.032025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22698): Terminated: ok {rc=0} 09:57:31.079569 --- ParallelTerminationStrategy: PID 22699 died... 09:57:31.099102 run iperf3-srv_10.42.42.10(pid=22699): Terminated {rc=256} 09:57:31.144046 --- ParallelTerminationStrategy: PID 22702 died... 09:57:31.164000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22702): Terminated: ok {rc=0} 09:57:31.210524 --- ParallelTerminationStrategy: PID 22705 died... 09:57:31.229845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22705): Terminated: ok {rc=0} 09:57:31.275220 --- ParallelTerminationStrategy: PID 22708 died... 09:57:31.294599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22708): Terminated: ok {rc=0} 09:57:31.384734 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:57:32.529528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:32.540807 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:57:32.577672 tst iperf3m4.py: using LAC 20669 09:57:32.697649 tst iperf3m4.py: using RAC 14 09:57:32.815211 tst iperf3m4.py: using CellId 20669 09:57:32.935457 tst iperf3m4.py: using BVCI 20670 09:57:33.046954 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.057876 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.068596 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.079309 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.089950 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.100582 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.111373 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.121952 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:33.132617 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:33.250388 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:33.370766 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:33.489060 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:33.607066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:57:33.826361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:34.154015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22710): Launched 09:57:34.436740 run iperf3-srv_10.42.42.10(pid=22711): Launched 09:57:34.558330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:57:34.775557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:35.100808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22712): Launched 09:57:35.382443 run iperf3-srv_10.42.42.10(pid=22713): Launched 09:57:35.503624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:57:35.721406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:36.049405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22717): Launched 09:57:36.331784 run iperf3-srv_10.42.42.10(pid=22718): Launched 09:57:36.454368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:57:36.671401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:36.995687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22719): Launched 09:57:37.277257 run iperf3-srv_10.42.42.10(pid=22720): Launched 09:57:37.398152 tst iperf3m4.py:8: start network... 09:57:37.614937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:38.116483 run create_hlr_db(pid=22721): Launched 09:57:38.238745 bus /gobi_6: Setting Powered False 09:57:39.302734 run create_hlr_db(pid=22721): Terminated: ok {rc=0} 09:57:39.752337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22723): Launched 09:57:40.076132 run osmo-hlr_10.42.42.2(pid=22724): Launched 09:57:40.199773 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:40.754074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22726): Launched 09:57:41.076595 run osmo-stp_10.42.42.5(pid=22727): Launched 09:57:41.201424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:41.758021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22729): Launched 09:57:41.880930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:42.154645 run patchelf(pid=22730): Launched 09:57:42.335685 run osmo-stp_10.42.42.5(pid=22727): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22727)] 09:57:42.473803 run osmo-stp_10.42.42.5(pid=22727): stdout: | (launched: 2022-12-09_09:57:41.017523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:42.612783 run osmo-stp_10.42.42.5(pid=22727): stderr: | 20221209095741206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095741206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095741206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095741207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095741207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095741207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095741207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:42.752053 run osmo-stp_10.42.42.5(pid=22727): stdout: | (launched: 2022-12-09_09:57:41.017523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:42.886395 run osmo-stp_10.42.42.5(pid=22727): stderr: | 20221209095741206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095741206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095741206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095741207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095741207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095741207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095741207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:43.046197 run patchelf(pid=22730): Terminating (SIGINT) 09:57:43.229155 run patchelf(pid=22730): Terminated: ok {rc=0} 09:57:43.360575 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22727): Process ended prematurely: osmo-stp_10.42.42.5(pid=22727) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22727)] [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 09:57:43.370926 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:57:43.400494 run osmo-hlr_10.42.42.2(pid=22724): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22724)] 09:57:43.451519 run osmo-hlr_10.42.42.2(pid=22724): stdout: | (launched: 2022-12-09_09:57:40.016640) 09:57:43.504237 run osmo-hlr_10.42.42.2(pid=22724): stderr: | 20221209095740211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095740211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095740211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095740211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095740211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095740211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095740223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095740231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095740231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095740231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:43.557452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22710): Terminating (SIGTERM) 09:57:43.599698 run iperf3-srv_10.42.42.10(pid=22711): Terminating (SIGTERM) 09:57:43.642205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22712): Terminating (SIGTERM) 09:57:43.684645 run iperf3-srv_10.42.42.10(pid=22713): Terminating (SIGTERM) 09:57:43.727084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22717): Terminating (SIGTERM) 09:57:43.769519 run iperf3-srv_10.42.42.10(pid=22718): Terminating (SIGTERM) 09:57:43.811859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22719): Terminating (SIGTERM) 09:57:43.854273 run iperf3-srv_10.42.42.10(pid=22720): Terminating (SIGTERM) 09:57:43.896367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22723): Terminating (SIGTERM) 09:57:43.938981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22726): Terminating (SIGTERM) 09:57:43.981604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22729): Terminating (SIGTERM) 09:57:44.024244 --- ParallelTerminationStrategy: PID 22710 died... 09:57:44.044359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22710): Terminated: ok {rc=0} 09:57:44.091329 --- ParallelTerminationStrategy: PID 22711 died... 09:57:44.110693 run iperf3-srv_10.42.42.10(pid=22711): Terminated {rc=256} 09:57:44.157443 --- ParallelTerminationStrategy: PID 22712 died... 09:57:44.177090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22712): Terminated: ok {rc=0} 09:57:44.224059 --- ParallelTerminationStrategy: PID 22713 died... 09:57:44.243606 run iperf3-srv_10.42.42.10(pid=22713): Terminated {rc=256} 09:57:44.290233 --- ParallelTerminationStrategy: PID 22717 died... 09:57:44.309848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22717): Terminated: ok {rc=0} 09:57:44.356861 --- ParallelTerminationStrategy: PID 22718 died... 09:57:44.376889 run iperf3-srv_10.42.42.10(pid=22718): Terminated {rc=256} 09:57:44.424118 --- ParallelTerminationStrategy: PID 22719 died... 09:57:44.443843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22719): Terminated: ok {rc=0} 09:57:44.490969 --- ParallelTerminationStrategy: PID 22720 died... 09:57:44.510779 run iperf3-srv_10.42.42.10(pid=22720): Terminated {rc=256} 09:57:44.557583 --- ParallelTerminationStrategy: PID 22723 died... 09:57:44.577336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22723): Terminated: ok {rc=0} 09:57:44.624117 --- ParallelTerminationStrategy: PID 22726 died... 09:57:44.643908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22726): Terminated: ok {rc=0} 09:57:44.690865 --- ParallelTerminationStrategy: PID 22729 died... 09:57:44.710673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22729): Terminated: ok {rc=0} 09:57:44.798953 bus /gobi_4: Setting Powered False 09:57:45.909699 bus /gobi_4: Setting Powered False 09:57:47.031928 bus /gobi_1: Setting Powered False 09:57:48.142733 bus /gobi_1: Setting Powered False 09:57:49.259485 bus /gobi_0: Setting Powered False 09:57:50.359989 bus /gobi_0: Setting Powered False 09:57:51.477866 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 09:57:52.579395 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:52.590716 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:57:52.627865 tst ping.py: using LAC 20670 09:57:52.747355 tst ping.py: using RAC 15 09:57:52.867346 tst ping.py: using CellId 20670 09:57:52.986572 tst ping.py: using BVCI 20671 09:57:53.097644 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.108248 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.118956 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.129532 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.139929 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.150431 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.161069 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:57:53.171636 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:57:53.290961 tst ping.py:19: start network... 09:57:53.509098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:54.011311 run create_hlr_db(pid=22731): Launched 09:57:54.134766 bus /gobi_6: Setting Powered False 09:57:55.198770 run create_hlr_db(pid=22731): Terminated: ok {rc=0} 09:57:55.649343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22733): Launched 09:57:55.971263 run osmo-hlr_10.42.42.2(pid=22734): Launched 09:57:56.096691 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:56.654433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22736): Launched 09:57:56.977140 run osmo-stp_10.42.42.5(pid=22737): Launched 09:57:57.102217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:57.656610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22739): Launched 09:57:57.781387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:58.054008 run patchelf(pid=22740): Launched 09:57:58.234476 run osmo-stp_10.42.42.5(pid=22737): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22737)] 09:57:58.371207 run osmo-stp_10.42.42.5(pid=22737): stdout: | (launched: 2022-12-09_09:57:56.918117) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:58.508586 run osmo-stp_10.42.42.5(pid=22737): stderr: | 20221209095757110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095757110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095757110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095757110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095757113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095757113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095757113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:58.646189 run osmo-stp_10.42.42.5(pid=22737): stdout: | (launched: 2022-12-09_09:57:56.918117) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:58.777952 run osmo-stp_10.42.42.5(pid=22737): stderr: | 20221209095757110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095757110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095757110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095757110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095757113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095757113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095757113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:58.934141 run patchelf(pid=22740): Terminating (SIGINT) 09:57:59.113955 run patchelf(pid=22740): Terminated: ok {rc=0} 09:57:59.243281 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22737): Process ended prematurely: osmo-stp_10.42.42.5(pid=22737) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22737)] [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 09:57:59.252910 tst ping.py:22: Test FAILED (6.7 sec) 09:57:59.281809 run osmo-hlr_10.42.42.2(pid=22734): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22734)] 09:57:59.332711 run osmo-hlr_10.42.42.2(pid=22734): stdout: | (launched: 2022-12-09_09:57:55.912020) 09:57:59.385400 run osmo-hlr_10.42.42.2(pid=22734): stderr: | 20221209095756112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095756112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095756112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095756112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095756113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095756113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095756125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095756133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095756133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095756133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:59.438619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22733): Terminating (SIGTERM) 09:57:59.481137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22736): Terminating (SIGTERM) 09:57:59.523695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22739): Terminating (SIGTERM) 09:57:59.566410 --- ParallelTerminationStrategy: PID 22733 died... 09:57:59.586585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22733): Terminated: ok {rc=0} 09:57:59.634040 --- ParallelTerminationStrategy: PID 22736 died... 09:57:59.653885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22736): Terminated: ok {rc=0} 09:57:59.701066 --- ParallelTerminationStrategy: PID 22739 died... 09:57:59.720846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22739): Terminated: ok {rc=0} 09:57:59.810502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:58:00.909934 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:00.922926 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:58:00.967243 tst ping_idle_ping.py: using LAC 20671 09:58:01.095632 tst ping_idle_ping.py: using RAC 16 09:58:01.222850 tst ping_idle_ping.py: using CellId 20671 09:58:01.375740 tst ping_idle_ping.py: using BVCI 20672 09:58:01.492680 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.504711 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.521686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.534566 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.546193 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.559067 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.571871 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:58:01.584611 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:58:01.711619 tst ping_idle_ping.py:24: start network... 09:58:01.935274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:02.447276 run create_hlr_db(pid=22741): Launched 09:58:02.570348 bus /gobi_6: Setting Powered False 09:58:03.633645 run create_hlr_db(pid=22741): Terminated: ok {rc=0} 09:58:04.065741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22743): Launched 09:58:04.368506 run osmo-hlr_10.42.42.2(pid=22744): Launched 09:58:04.482817 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:05.019322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22746): Launched 09:58:05.319286 run osmo-stp_10.42.42.5(pid=22747): Launched 09:58:05.433860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:05.954229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22749): Launched 09:58:06.069192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:06.322794 run patchelf(pid=22750): Launched 09:58:06.489745 run osmo-stp_10.42.42.5(pid=22747): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22747)] 09:58:06.616703 run osmo-stp_10.42.42.5(pid=22747): stdout: | (launched: 2022-12-09_09:58:05.263524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:06.745193 run osmo-stp_10.42.42.5(pid=22747): stderr: | 20221209095805437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095805437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095805438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095805438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095805439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095805439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095805439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:06.873234 run osmo-stp_10.42.42.5(pid=22747): stdout: | (launched: 2022-12-09_09:58:05.263524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:06.995732 run osmo-stp_10.42.42.5(pid=22747): stderr: | 20221209095805437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095805437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095805438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095805438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095805439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095805439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095805439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:07.141208 run patchelf(pid=22750): Terminating (SIGINT) 09:58:07.308845 run patchelf(pid=22750): Terminated: ok {rc=0} 09:58:07.429690 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22747): Process ended prematurely: osmo-stp_10.42.42.5(pid=22747) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22747)] [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 09:58:07.438604 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:58:07.465266 run osmo-hlr_10.42.42.2(pid=22744): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22744)] 09:58:07.513079 run osmo-hlr_10.42.42.2(pid=22744): stdout: | (launched: 2022-12-09_09:58:04.311672) 09:58:07.562395 run osmo-hlr_10.42.42.2(pid=22744): stderr: | 20221209095804488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095804488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095804488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095804488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095804488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095804488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095804500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095804510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095804510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095804510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:07.612116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22743): Terminating (SIGTERM) 09:58:07.652078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22746): Terminating (SIGTERM) 09:58:07.692154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22749): Terminating (SIGTERM) 09:58:07.732489 --- ParallelTerminationStrategy: PID 22743 died... 09:58:07.751928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22743): Terminated: ok {rc=0} 09:58:07.796387 --- ParallelTerminationStrategy: PID 22746 died... 09:58:07.815256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22746): Terminated: ok {rc=0} 09:58:07.859449 --- ParallelTerminationStrategy: PID 22749 died... 09:58:07.878204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22749): Terminated: ok {rc=0} 09:58:07.963170 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:58:09.246790 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:09.252646 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:58:09.273403 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:58:09.311363 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:58:09.399437 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:58:09.421127 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:58:09.462457 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:58:10.048836 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:58:10.104492 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.115958 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:58:10.174863 tst cs_paging_gprs_active.py: using LAC 20672 09:58:10.306395 tst cs_paging_gprs_active.py: using RAC 17 09:58:10.437049 tst cs_paging_gprs_active.py: using CellId 20672 09:58:10.557923 tst cs_paging_gprs_active.py: using BVCI 20673 09:58:10.670852 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.682010 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.692730 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.703298 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.713991 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.724612 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.735385 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.745883 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:10.756490 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:10.877599 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:10.999378 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:58:11.222420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:11.553536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22754): Launched 09:58:11.841049 run iperf3-srv_10.42.42.10(pid=22755): Launched 09:58:11.964570 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:58:12.186845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:12.516585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22756): Launched 09:58:12.801672 run iperf3-srv_10.42.42.10(pid=22757): Launched 09:58:12.926834 tst cs_paging_gprs_active.py:38: start network... 09:58:13.149104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:13.660284 run create_hlr_db(pid=22758): Launched 09:58:13.787561 bus /gobi_6: Setting Powered False 09:58:14.852044 run create_hlr_db(pid=22758): Terminated: ok {rc=0} 09:58:15.289154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22760): Launched 09:58:15.597377 run osmo-hlr_10.42.42.2(pid=22761): Launched 09:58:15.716206 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:16.351556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22763): Launched 09:58:16.703127 run osmo-stp_10.42.42.5(pid=22764): Launched 09:58:16.957219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:17.564656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22766): Launched 09:58:17.681467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:17.939759 run patchelf(pid=22767): Launched 09:58:18.110095 run osmo-stp_10.42.42.5(pid=22764): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22764)] 09:58:18.239101 run osmo-stp_10.42.42.5(pid=22764): stdout: | (launched: 2022-12-09_09:58:16.640146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:18.370107 run osmo-stp_10.42.42.5(pid=22764): stderr: | 20221209095816941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095816941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095816941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095816942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095816942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095816942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095816942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:18.500585 run osmo-stp_10.42.42.5(pid=22764): stdout: | (launched: 2022-12-09_09:58:16.640146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:18.625771 run osmo-stp_10.42.42.5(pid=22764): stderr: | 20221209095816941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095816941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095816941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095816942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095816942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095816942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095816942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:18.774210 run patchelf(pid=22767): Terminating (SIGINT) 09:58:18.945549 run patchelf(pid=22767): Terminated: ok {rc=0} 09:58:19.069274 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22764): Process ended prematurely: osmo-stp_10.42.42.5(pid=22764) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22764)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:58:19.078718 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 09:58:19.106091 run osmo-hlr_10.42.42.2(pid=22761): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22761)] 09:58:19.154251 run osmo-hlr_10.42.42.2(pid=22761): stdout: | (launched: 2022-12-09_09:58:15.540725) 09:58:19.204094 run osmo-hlr_10.42.42.2(pid=22761): stderr: | 20221209095815716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095815716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095815716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095815716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095815716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095815716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095815729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095815738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095815739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095815739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:19.254418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22754): Terminating (SIGTERM) 09:58:19.294692 run iperf3-srv_10.42.42.10(pid=22755): Terminating (SIGTERM) 09:58:19.334758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22756): Terminating (SIGTERM) 09:58:19.374968 run iperf3-srv_10.42.42.10(pid=22757): Terminating (SIGTERM) 09:58:19.415109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22760): Terminating (SIGTERM) 09:58:19.455347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22763): Terminating (SIGTERM) 09:58:19.495472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22766): Terminating (SIGTERM) 09:58:19.536016 --- ParallelTerminationStrategy: PID 22754 died... 09:58:19.555359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22754): Terminated: ok {rc=0} 09:58:19.599981 --- ParallelTerminationStrategy: PID 22755 died... 09:58:19.618715 run iperf3-srv_10.42.42.10(pid=22755): Terminated {rc=256} 09:58:19.663158 --- ParallelTerminationStrategy: PID 22756 died... 09:58:19.682139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22756): Terminated: ok {rc=0} 09:58:19.727078 --- ParallelTerminationStrategy: PID 22757 died... 09:58:19.745965 run iperf3-srv_10.42.42.10(pid=22757): Terminated {rc=256} 09:58:19.790407 --- ParallelTerminationStrategy: PID 22760 died... 09:58:19.809341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22760): Terminated: ok {rc=0} 09:58:19.853883 --- ParallelTerminationStrategy: PID 22763 died... 09:58:19.872803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22763): Terminated: ok {rc=0} 09:58:19.917309 --- ParallelTerminationStrategy: PID 22766 died... 09:58:19.936118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22766): Terminated: ok {rc=0} 09:58:20.022771 bus /gobi_0: Setting Powered False 09:58:21.124127 bus /gobi_0: Setting Powered False 09:58:22.241086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:58:23.389418 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:23.400791 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:58:23.459297 tst iperf3.py: using LAC 20673 09:58:23.581772 tst iperf3.py: using RAC 18 09:58:23.702487 tst iperf3.py: using CellId 20673 09:58:23.824564 tst iperf3.py: using BVCI 20674 09:58:23.936239 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:23.947132 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:23.957755 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:23.968390 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:23.978972 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:23.989576 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:24.000239 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:24.011095 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:24.021878 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:24.140614 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:58:24.362864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:24.693754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Launched 09:58:24.982676 run iperf3-srv_10.42.42.10(pid=22769): Launched 09:58:25.108333 tst iperf3.py:8: start network... 09:58:25.329449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:25.838210 run create_hlr_db(pid=22770): Launched 09:58:25.964869 bus /gobi_6: Setting Powered False 09:58:27.030095 run create_hlr_db(pid=22770): Terminated: ok {rc=0} 09:58:27.466868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22772): Launched 09:58:27.772181 run osmo-hlr_10.42.42.2(pid=22773): Launched 09:58:27.888716 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:28.415389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22775): Launched 09:58:28.719526 run osmo-stp_10.42.42.5(pid=22776): Launched 09:58:28.835622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:29.363057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22778): Launched 09:58:29.479189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:29.736919 run patchelf(pid=22779): Launched 09:58:29.906427 run osmo-stp_10.42.42.5(pid=22776): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22776)] 09:58:30.035255 run osmo-stp_10.42.42.5(pid=22776): stdout: | (launched: 2022-12-09_09:58:28.663311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:30.166319 run osmo-stp_10.42.42.5(pid=22776): stderr: | 20221209095828833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095828833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095828834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095828834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095828834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095828834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095828835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:30.296551 run osmo-stp_10.42.42.5(pid=22776): stdout: | (launched: 2022-12-09_09:58:28.663311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:30.421587 run osmo-stp_10.42.42.5(pid=22776): stderr: | 20221209095828833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095828833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095828834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095828834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095828834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095828834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095828835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:30.569384 run patchelf(pid=22779): Terminating (SIGINT) 09:58:30.740020 run patchelf(pid=22779): Terminated: ok {rc=0} 09:58:30.881078 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22776): Process ended prematurely: osmo-stp_10.42.42.5(pid=22776) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22776)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 09:58:30.891546 tst iperf3.py:8: Test FAILED (7.5 sec) 09:58:30.924918 run osmo-hlr_10.42.42.2(pid=22773): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22773)] 09:58:30.974332 run osmo-hlr_10.42.42.2(pid=22773): stdout: | (launched: 2022-12-09_09:58:27.716101) 09:58:31.025187 run osmo-hlr_10.42.42.2(pid=22773): stderr: | 20221209095827893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095827893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095827893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095827893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095827893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095827893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095827905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095827914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095827914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095827915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:31.077188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Terminating (SIGTERM) 09:58:31.118884 run iperf3-srv_10.42.42.10(pid=22769): Terminating (SIGTERM) 09:58:31.163281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22772): Terminating (SIGTERM) 09:58:31.205714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22775): Terminating (SIGTERM) 09:58:31.247289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22778): Terminating (SIGTERM) 09:58:31.289894 --- ParallelTerminationStrategy: PID 22768 died... 09:58:31.309990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Terminated: ok {rc=0} 09:58:31.357604 --- ParallelTerminationStrategy: PID 22769 died... 09:58:31.376812 run iperf3-srv_10.42.42.10(pid=22769): Terminated {rc=256} 09:58:31.422015 --- ParallelTerminationStrategy: PID 22772 died... 09:58:31.441826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22772): Terminated: ok {rc=0} 09:58:31.487460 --- ParallelTerminationStrategy: PID 22775 died... 09:58:31.507343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22775): Terminated: ok {rc=0} 09:58:31.553264 --- ParallelTerminationStrategy: PID 22778 died... 09:58:31.572610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22778): Terminated: ok {rc=0} 09:58:31.660525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:58:32.806109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:32.817775 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:58:32.873324 tst iperf3m4.py: using LAC 20674 09:58:32.994600 tst iperf3m4.py: using RAC 19 09:58:33.113680 tst iperf3m4.py: using CellId 20674 09:58:33.230901 tst iperf3m4.py: using BVCI 20675 09:58:33.342905 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.353916 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.364456 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.375069 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.385744 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.396411 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.407316 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.417852 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:33.428543 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:33.549548 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:33.674471 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:33.791318 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:33.912541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:58:34.135508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:34.466760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22781): Launched 09:58:34.754817 run iperf3-srv_10.42.42.10(pid=22782): Launched 09:58:34.880404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:58:35.101620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:35.430762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22783): Launched 09:58:35.717448 run iperf3-srv_10.42.42.10(pid=22784): Launched 09:58:35.840694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:58:36.061891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:36.392129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22785): Launched 09:58:36.677364 run iperf3-srv_10.42.42.10(pid=22786): Launched 09:58:36.801987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:58:37.023423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:37.354668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22787): Launched 09:58:37.643240 run iperf3-srv_10.42.42.10(pid=22788): Launched 09:58:37.767619 tst iperf3m4.py:8: start network... 09:58:37.987621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:38.497125 run create_hlr_db(pid=22789): Launched 09:58:38.621310 bus /gobi_6: Setting Powered False 09:58:39.686082 run create_hlr_db(pid=22789): Terminated: ok {rc=0} 09:58:40.122959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22791): Launched 09:58:40.428778 run osmo-hlr_10.42.42.2(pid=22792): Launched 09:58:40.545538 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:41.083235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22794): Launched 09:58:41.388272 run osmo-stp_10.42.42.5(pid=22795): Launched 09:58:41.504165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:42.030227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22797): Launched 09:58:42.146126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:42.403853 run patchelf(pid=22798): Launched 09:58:42.573633 run osmo-stp_10.42.42.5(pid=22795): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22795)] 09:58:42.702374 run osmo-stp_10.42.42.5(pid=22795): stdout: | (launched: 2022-12-09_09:58:41.332160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:42.832041 run osmo-stp_10.42.42.5(pid=22795): stderr: | 20221209095841499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095841499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095841499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095841500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095841500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095841500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095841500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:42.962444 run osmo-stp_10.42.42.5(pid=22795): stdout: | (launched: 2022-12-09_09:58:41.332160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:43.087318 run osmo-stp_10.42.42.5(pid=22795): stderr: | 20221209095841499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095841499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095841499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095841500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095841500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095841500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095841500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:43.235708 run patchelf(pid=22798): Terminating (SIGINT) 09:58:43.406569 run patchelf(pid=22798): Terminated: ok {rc=0} 09:58:43.529391 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22795): Process ended prematurely: osmo-stp_10.42.42.5(pid=22795) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22795)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:58:43.538928 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:58:43.566703 run osmo-hlr_10.42.42.2(pid=22792): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22792)] 09:58:43.614665 run osmo-hlr_10.42.42.2(pid=22792): stdout: | (launched: 2022-12-09_09:58:40.372313) 09:58:43.664575 run osmo-hlr_10.42.42.2(pid=22792): stderr: | 20221209095840546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095840546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095840546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095840546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095840546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095840546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095840570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095840579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095840580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095840580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:43.714935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22781): Terminating (SIGTERM) 09:58:43.755225 run iperf3-srv_10.42.42.10(pid=22782): Terminating (SIGTERM) 09:58:43.795564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22783): Terminating (SIGTERM) 09:58:43.836092 run iperf3-srv_10.42.42.10(pid=22784): Terminating (SIGTERM) 09:58:43.876441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22785): Terminating (SIGTERM) 09:58:43.916836 run iperf3-srv_10.42.42.10(pid=22786): Terminating (SIGTERM) 09:58:43.957079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22787): Terminating (SIGTERM) 09:58:43.997863 run iperf3-srv_10.42.42.10(pid=22788): Terminating (SIGTERM) 09:58:44.038173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22791): Terminating (SIGTERM) 09:58:44.078545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22794): Terminating (SIGTERM) 09:58:44.118847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22797): Terminating (SIGTERM) 09:58:44.159321 --- ParallelTerminationStrategy: PID 22781 died... 09:58:44.179067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22781): Terminated: ok {rc=0} 09:58:44.224086 --- ParallelTerminationStrategy: PID 22782 died... 09:58:44.242817 run iperf3-srv_10.42.42.10(pid=22782): Terminated {rc=256} 09:58:44.287458 --- ParallelTerminationStrategy: PID 22783 died... 09:58:44.306414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22783): Terminated: ok {rc=0} 09:58:44.350827 --- ParallelTerminationStrategy: PID 22784 died... 09:58:44.369646 run iperf3-srv_10.42.42.10(pid=22784): Terminated {rc=256} 09:58:44.414505 --- ParallelTerminationStrategy: PID 22785 died... 09:58:44.433358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22785): Terminated: ok {rc=0} 09:58:44.477856 --- ParallelTerminationStrategy: PID 22786 died... 09:58:44.496621 run iperf3-srv_10.42.42.10(pid=22786): Terminated {rc=256} 09:58:44.541046 --- ParallelTerminationStrategy: PID 22787 died... 09:58:44.559897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22787): Terminated: ok {rc=0} 09:58:44.604300 --- ParallelTerminationStrategy: PID 22788 died... 09:58:44.623233 run iperf3-srv_10.42.42.10(pid=22788): Terminated {rc=256} 09:58:44.667608 --- ParallelTerminationStrategy: PID 22791 died... 09:58:44.686662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22791): Terminated: ok {rc=0} 09:58:44.731319 --- ParallelTerminationStrategy: PID 22794 died... 09:58:44.750256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22794): Terminated: ok {rc=0} 09:58:44.794622 --- ParallelTerminationStrategy: PID 22797 died... 09:58:44.813571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22797): Terminated: ok {rc=0} 09:58:44.900229 bus /gobi_4: Setting Powered False 09:58:46.004306 bus /gobi_4: Setting Powered False 09:58:47.155486 bus /gobi_1: Setting Powered False 09:58:48.262899 bus /gobi_1: Setting Powered False 09:58:49.381435 bus /gobi_0: Setting Powered False 09:58:50.483283 bus /gobi_0: Setting Powered False 09:58:51.600581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:58:52.705684 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:52.717817 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:58:52.775044 tst ping.py: using LAC 20675 09:58:52.897560 tst ping.py: using RAC 20 09:58:53.015869 tst ping.py: using CellId 20675 09:58:53.136253 tst ping.py: using BVCI 20676 09:58:53.247019 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.258122 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.268630 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.279312 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.289816 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.300778 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.311722 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:58:53.322574 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:58:53.436389 tst ping.py:19: start network... 09:58:53.637304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:54.102616 run create_hlr_db(pid=22799): Launched 09:58:54.226929 bus /gobi_6: Setting Powered False 09:58:55.286586 run create_hlr_db(pid=22799): Terminated: ok {rc=0} 09:58:55.729077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22801): Launched 09:58:56.051787 run osmo-hlr_10.42.42.2(pid=22802): Launched 09:58:56.174932 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:56.739830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22804): Launched 09:58:57.062609 run osmo-stp_10.42.42.5(pid=22805): Launched 09:58:57.187055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:57.743222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22807): Launched 09:58:57.867851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:58.139795 run patchelf(pid=22808): Launched 09:58:58.318917 run osmo-stp_10.42.42.5(pid=22805): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22805)] 09:58:58.455521 run osmo-stp_10.42.42.5(pid=22805): stdout: | (launched: 2022-12-09_09:58:57.003108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:58.593180 run osmo-stp_10.42.42.5(pid=22805): stderr: | 20221209095857195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095857195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095857195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095857195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095857196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095857196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095857196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:58.730449 run osmo-stp_10.42.42.5(pid=22805): stdout: | (launched: 2022-12-09_09:58:57.003108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:58.862892 run osmo-stp_10.42.42.5(pid=22805): stderr: | 20221209095857195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095857195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095857195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095857195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095857196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095857196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095857196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:59.019500 run patchelf(pid=22808): Terminating (SIGINT) 09:58:59.199341 run patchelf(pid=22808): Terminated: ok {rc=0} 09:58:59.329187 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22805): Process ended prematurely: osmo-stp_10.42.42.5(pid=22805) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22805)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 09:58:59.338766 tst ping.py:22: Test FAILED (6.6 sec) 09:58:59.367816 run osmo-hlr_10.42.42.2(pid=22802): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22802)] 09:58:59.418956 run osmo-hlr_10.42.42.2(pid=22802): stdout: | (launched: 2022-12-09_09:58:55.992172) 09:58:59.471779 run osmo-hlr_10.42.42.2(pid=22802): stderr: | 20221209095856191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095856191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095856191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095856192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095856192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095856192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095856204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095856212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095856212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095856212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:59.524793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22801): Terminating (SIGTERM) 09:58:59.567499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22804): Terminating (SIGTERM) 09:58:59.610139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22807): Terminating (SIGTERM) 09:58:59.652909 --- ParallelTerminationStrategy: PID 22801 died... 09:58:59.673220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22801): Terminated: ok {rc=0} 09:58:59.720309 --- ParallelTerminationStrategy: PID 22804 died... 09:58:59.740079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22804): Terminated: ok {rc=0} 09:58:59.787360 --- ParallelTerminationStrategy: PID 22807 died... 09:58:59.806999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22807): Terminated: ok {rc=0} 09:58:59.894922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:59:00.984214 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:00.996652 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:59:01.056461 tst ping_idle_ping.py: using LAC 20676 09:59:01.176276 tst ping_idle_ping.py: using RAC 21 09:59:01.309304 tst ping_idle_ping.py: using CellId 20676 09:59:01.468566 tst ping_idle_ping.py: using BVCI 20677 09:59:01.582685 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.595163 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.606534 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.618330 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.630180 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.641839 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.653612 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:59:01.665306 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:59:01.786621 tst ping_idle_ping.py:24: start network... 09:59:02.051476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:02.558052 run create_hlr_db(pid=22809): Launched 09:59:02.684686 bus /gobi_6: Setting Powered False 09:59:03.744520 run create_hlr_db(pid=22809): Terminated: ok {rc=0} 09:59:04.165483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22811): Launched 09:59:04.471224 run osmo-hlr_10.42.42.2(pid=22812): Launched 09:59:04.587756 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:05.106972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22814): Launched 09:59:05.409533 run osmo-stp_10.42.42.5(pid=22815): Launched 09:59:05.524649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:06.046320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22817): Launched 09:59:06.160602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:06.414864 run patchelf(pid=22818): Launched 09:59:06.581599 run osmo-stp_10.42.42.5(pid=22815): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22815)] 09:59:06.709271 run osmo-stp_10.42.42.5(pid=22815): stdout: | (launched: 2022-12-09_09:59:05.353704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:06.838334 run osmo-stp_10.42.42.5(pid=22815): stderr: | 20221209095905523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095905523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095905524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095905524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095905525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095905525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095905525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:06.966729 run osmo-stp_10.42.42.5(pid=22815): stdout: | (launched: 2022-12-09_09:59:05.353704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:07.090004 run osmo-stp_10.42.42.5(pid=22815): stderr: | 20221209095905523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095905523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095905524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095905524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095905525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095905525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095905525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:07.235770 run patchelf(pid=22818): Terminating (SIGINT) 09:59:07.403316 run patchelf(pid=22818): Terminated: ok {rc=0} 09:59:07.524676 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22815): Process ended prematurely: osmo-stp_10.42.42.5(pid=22815) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22815)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:59:07.533918 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:59:07.560477 run osmo-hlr_10.42.42.2(pid=22812): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22812)] 09:59:07.608271 run osmo-hlr_10.42.42.2(pid=22812): stdout: | (launched: 2022-12-09_09:59:04.414850) 09:59:07.657826 run osmo-hlr_10.42.42.2(pid=22812): stderr: | 20221209095904594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095904594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095904594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095904594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095904594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095904594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095904607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095904616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095904616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095904616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:07.707856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22811): Terminating (SIGTERM) 09:59:07.747987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22814): Terminating (SIGTERM) 09:59:07.787905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22817): Terminating (SIGTERM) 09:59:07.828334 --- ParallelTerminationStrategy: PID 22811 died... 09:59:07.847529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22811): Terminated: ok {rc=0} 09:59:07.891869 --- ParallelTerminationStrategy: PID 22814 died... 09:59:07.910481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22814): Terminated: ok {rc=0} 09:59:07.954588 --- ParallelTerminationStrategy: PID 22817 died... 09:59:07.973378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22817): Terminated: ok {rc=0} 09:59:08.059423 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:59:09.352281 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:59:09.359017 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:59:09.380905 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:59:09.421211 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:59:09.510042 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:59:09.531637 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:59:09.571702 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:59:10.165081 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:59:10.219049 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.230514 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:59:10.288546 tst cs_paging_gprs_active.py: using LAC 20677 09:59:10.421604 tst cs_paging_gprs_active.py: using RAC 22 09:59:10.543163 tst cs_paging_gprs_active.py: using CellId 20677 09:59:10.664642 tst cs_paging_gprs_active.py: using BVCI 20678 09:59:10.775908 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.786929 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.797760 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.809147 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.820328 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.831609 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.842828 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.853863 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:10.865050 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:10.981217 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:11.102112 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:59:11.325241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:11.655342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22823): Launched 09:59:11.941305 run iperf3-srv_10.42.42.10(pid=22824): Launched 09:59:12.066299 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:59:12.287097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:12.616544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22825): Launched 09:59:12.900878 run iperf3-srv_10.42.42.10(pid=22826): Launched 09:59:13.024344 tst cs_paging_gprs_active.py:38: start network... 09:59:13.245132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:13.753249 run create_hlr_db(pid=22827): Launched 09:59:13.879001 bus /gobi_6: Setting Powered False 09:59:14.943693 run create_hlr_db(pid=22827): Terminated: ok {rc=0} 09:59:15.400196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22829): Launched 09:59:15.729299 run osmo-hlr_10.42.42.2(pid=22830): Launched 09:59:15.895995 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:16.534048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22832): Launched 09:59:16.855039 run osmo-stp_10.42.42.5(pid=22833): Launched 09:59:17.211510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:17.846583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22835): Launched 09:59:17.973202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:18.250907 run patchelf(pid=22836): Launched 09:59:18.434696 run osmo-stp_10.42.42.5(pid=22833): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22833)] 09:59:18.574304 run osmo-stp_10.42.42.5(pid=22833): stdout: | (launched: 2022-12-09_09:59:16.796206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:18.714942 run osmo-stp_10.42.42.5(pid=22833): stderr: | 20221209095917142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095917142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095917143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095917144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095917145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095917145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095917145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:18.855980 run osmo-stp_10.42.42.5(pid=22833): stdout: | (launched: 2022-12-09_09:59:16.796206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:18.991124 run osmo-stp_10.42.42.5(pid=22833): stderr: | 20221209095917142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095917142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095917143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095917144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095917145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095917145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095917145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:19.151973 run patchelf(pid=22836): Terminating (SIGINT) 09:59:19.336310 run patchelf(pid=22836): Terminated: ok {rc=0} 09:59:19.469394 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22833): Process ended prematurely: osmo-stp_10.42.42.5(pid=22833) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22833)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:59:19.479745 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 09:59:19.509335 run osmo-hlr_10.42.42.2(pid=22830): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22830)] 09:59:19.560415 run osmo-hlr_10.42.42.2(pid=22830): stdout: | (launched: 2022-12-09_09:59:15.668543) 09:59:19.613292 run osmo-hlr_10.42.42.2(pid=22830): stderr: | 20221209095915935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095915935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095915935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095915935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095915935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095915935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095915957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095915976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095915977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095915977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:19.666361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22823): Terminating (SIGTERM) 09:59:19.709169 run iperf3-srv_10.42.42.10(pid=22824): Terminating (SIGTERM) 09:59:19.751961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22825): Terminating (SIGTERM) 09:59:19.794920 run iperf3-srv_10.42.42.10(pid=22826): Terminating (SIGTERM) 09:59:19.837376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22829): Terminating (SIGTERM) 09:59:19.880047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22832): Terminating (SIGTERM) 09:59:19.922844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22835): Terminating (SIGTERM) 09:59:19.965751 --- ParallelTerminationStrategy: PID 22823 died... 09:59:19.985728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22823): Terminated: ok {rc=0} 09:59:20.033373 --- ParallelTerminationStrategy: PID 22824 died... 09:59:20.053226 run iperf3-srv_10.42.42.10(pid=22824): Terminated {rc=256} 09:59:20.100478 --- ParallelTerminationStrategy: PID 22825 died... 09:59:20.120261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22825): Terminated: ok {rc=0} 09:59:20.167395 --- ParallelTerminationStrategy: PID 22826 died... 09:59:20.187280 run iperf3-srv_10.42.42.10(pid=22826): Terminated {rc=256} 09:59:20.234389 --- ParallelTerminationStrategy: PID 22829 died... 09:59:20.254354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22829): Terminated: ok {rc=0} 09:59:20.301542 --- ParallelTerminationStrategy: PID 22832 died... 09:59:20.321464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22832): Terminated: ok {rc=0} 09:59:20.368704 --- ParallelTerminationStrategy: PID 22835 died... 09:59:20.388638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22835): Terminated: ok {rc=0} 09:59:20.478384 bus /gobi_0: Setting Powered False 09:59:21.578719 bus /gobi_0: Setting Powered False 09:59:22.695820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:59:23.847351 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:23.859337 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:59:23.921461 tst iperf3.py: using LAC 20678 09:59:24.041845 tst iperf3.py: using RAC 23 09:59:24.161009 tst iperf3.py: using CellId 20678 09:59:24.280696 tst iperf3.py: using BVCI 20679 09:59:24.393204 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.404236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.415104 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.426125 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.436886 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.447732 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.458696 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.469395 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:24.480284 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:24.600696 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:59:24.823435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:25.154544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22837): Launched 09:59:25.442801 run iperf3-srv_10.42.42.10(pid=22838): Launched 09:59:25.567654 tst iperf3.py:8: start network... 09:59:25.788829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:26.299017 run create_hlr_db(pid=22839): Launched 09:59:26.424365 bus /gobi_6: Setting Powered False 09:59:27.489855 run create_hlr_db(pid=22839): Terminated: ok {rc=0} 09:59:27.926968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22841): Launched 09:59:28.231753 run osmo-hlr_10.42.42.2(pid=22842): Launched 09:59:28.348378 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:28.895412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22844): Launched 09:59:29.200533 run osmo-stp_10.42.42.5(pid=22845): Launched 09:59:29.317108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:29.846201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22847): Launched 09:59:29.964455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:30.222982 run patchelf(pid=22848): Launched 09:59:30.392849 run osmo-stp_10.42.42.5(pid=22845): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22845)] 09:59:30.521850 run osmo-stp_10.42.42.5(pid=22845): stdout: | (launched: 2022-12-09_09:59:29.144159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:30.653880 run osmo-stp_10.42.42.5(pid=22845): stderr: | 20221209095929315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095929315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095929315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095929315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095929316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095929316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095929316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:30.784436 run osmo-stp_10.42.42.5(pid=22845): stdout: | (launched: 2022-12-09_09:59:29.144159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:30.934534 run osmo-stp_10.42.42.5(pid=22845): stderr: | 20221209095929315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095929315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095929315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095929315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095929316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095929316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095929316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:31.101729 run patchelf(pid=22848): Terminating (SIGINT) 09:59:31.291560 run patchelf(pid=22848): Terminated: ok {rc=0} 09:59:31.431758 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22845): Process ended prematurely: osmo-stp_10.42.42.5(pid=22845) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22845)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 09:59:31.443334 tst iperf3.py:8: Test FAILED (7.6 sec) 09:59:31.476066 run osmo-hlr_10.42.42.2(pid=22842): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22842)] 09:59:31.530230 run osmo-hlr_10.42.42.2(pid=22842): stdout: | (launched: 2022-12-09_09:59:28.175590) 09:59:31.586829 run osmo-hlr_10.42.42.2(pid=22842): stderr: | 20221209095928354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095928354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095928354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095928354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095928354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095928354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095928366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095928375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095928375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095928376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:31.643915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22837): Terminating (SIGTERM) 09:59:31.690442 run iperf3-srv_10.42.42.10(pid=22838): Terminating (SIGTERM) 09:59:31.738437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22841): Terminating (SIGTERM) 09:59:31.784627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22844): Terminating (SIGTERM) 09:59:31.833169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22847): Terminating (SIGTERM) 09:59:31.881199 --- ParallelTerminationStrategy: PID 22837 died... 09:59:31.902400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22837): Terminated: ok {rc=0} 09:59:31.954478 --- ParallelTerminationStrategy: PID 22838 died... 09:59:31.975393 run iperf3-srv_10.42.42.10(pid=22838): Terminated {rc=256} 09:59:32.027206 --- ParallelTerminationStrategy: PID 22841 died... 09:59:32.048535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22841): Terminated: ok {rc=0} 09:59:32.100107 --- ParallelTerminationStrategy: PID 22844 died... 09:59:32.121280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22844): Terminated: ok {rc=0} 09:59:32.172615 --- ParallelTerminationStrategy: PID 22847 died... 09:59:32.194363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22847): Terminated: ok {rc=0} 09:59:32.286355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:59:33.438910 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:33.450793 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:59:33.509258 tst iperf3m4.py: using LAC 20679 09:59:33.638660 tst iperf3m4.py: using RAC 24 09:59:33.767061 tst iperf3m4.py: using CellId 20679 09:59:33.895599 tst iperf3m4.py: using BVCI 20680 09:59:34.017359 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.028577 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.040078 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.051505 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.062903 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.074214 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.085865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.097255 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:34.108797 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:34.229203 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:34.351956 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:34.473534 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:34.589441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:59:34.793629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:35.099990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22849): Launched 09:59:35.366263 run iperf3-srv_10.42.42.10(pid=22850): Launched 09:59:35.481892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:59:35.684239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:35.989312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22851): Launched 09:59:36.254610 run iperf3-srv_10.42.42.10(pid=22852): Launched 09:59:36.370339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:59:36.572714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:36.878940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22853): Launched 09:59:37.146585 run iperf3-srv_10.42.42.10(pid=22854): Launched 09:59:37.262164 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:59:37.464444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:37.769654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22855): Launched 09:59:38.035984 run iperf3-srv_10.42.42.10(pid=22856): Launched 09:59:38.149845 tst iperf3m4.py:8: start network... 09:59:38.352283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:38.826830 run create_hlr_db(pid=22857): Launched 09:59:38.951839 bus /gobi_6: Setting Powered False 09:59:40.011510 run create_hlr_db(pid=22857): Terminated: ok {rc=0} 09:59:40.458389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22859): Launched 09:59:40.787777 run osmo-hlr_10.42.42.2(pid=22860): Launched 09:59:40.915174 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:41.488146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22863): Launched 09:59:41.817840 run osmo-stp_10.42.42.5(pid=22864): Launched 09:59:41.942399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:42.508455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22866): Launched 09:59:42.635471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:42.913754 run patchelf(pid=22867): Launched 09:59:43.097556 run osmo-stp_10.42.42.5(pid=22864): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22864)] 09:59:43.237339 run osmo-stp_10.42.42.5(pid=22864): stdout: | (launched: 2022-12-09_09:59:41.757432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:43.378314 run osmo-stp_10.42.42.5(pid=22864): stderr: | 20221209095941946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095941946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095941946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095941947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095941947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095941947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095941947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:43.520026 run osmo-stp_10.42.42.5(pid=22864): stdout: | (launched: 2022-12-09_09:59:41.757432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:43.656010 run osmo-stp_10.42.42.5(pid=22864): stderr: | 20221209095941946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095941946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095941946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095941947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095941947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095941947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095941947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:43.817305 run patchelf(pid=22867): Terminating (SIGINT) 09:59:44.002614 run patchelf(pid=22867): Terminated: ok {rc=0} 09:59:44.136643 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22864): Process ended prematurely: osmo-stp_10.42.42.5(pid=22864) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22864)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:59:44.147064 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:59:44.177117 run osmo-hlr_10.42.42.2(pid=22860): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22860)] 09:59:44.228603 run osmo-hlr_10.42.42.2(pid=22860): stdout: | (launched: 2022-12-09_09:59:40.727665) 09:59:44.281859 run osmo-hlr_10.42.42.2(pid=22860): stderr: | 20221209095940924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095940924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095940924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095940924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095940924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095940924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095940936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095940946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095940946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095940946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:44.335430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22849): Terminating (SIGTERM) 09:59:44.378305 run iperf3-srv_10.42.42.10(pid=22850): Terminating (SIGTERM) 09:59:44.421490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22851): Terminating (SIGTERM) 09:59:44.464915 run iperf3-srv_10.42.42.10(pid=22852): Terminating (SIGTERM) 09:59:44.507967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22853): Terminating (SIGTERM) 09:59:44.551185 run iperf3-srv_10.42.42.10(pid=22854): Terminating (SIGTERM) 09:59:44.594117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22855): Terminating (SIGTERM) 09:59:44.637041 run iperf3-srv_10.42.42.10(pid=22856): Terminating (SIGTERM) 09:59:44.679969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22859): Terminating (SIGTERM) 09:59:44.723266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22863): Terminating (SIGTERM) 09:59:44.766304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22866): Terminating (SIGTERM) 09:59:44.809757 --- ParallelTerminationStrategy: PID 22849 died... 09:59:44.830139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22849): Terminated: ok {rc=0} 09:59:44.878023 --- ParallelTerminationStrategy: PID 22850 died... 09:59:44.897831 run iperf3-srv_10.42.42.10(pid=22850): Terminated {rc=256} 09:59:44.945272 --- ParallelTerminationStrategy: PID 22851 died... 09:59:44.965726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22851): Terminated: ok {rc=0} 09:59:45.013412 --- ParallelTerminationStrategy: PID 22852 died... 09:59:45.033355 run iperf3-srv_10.42.42.10(pid=22852): Terminated {rc=256} 09:59:45.081212 --- ParallelTerminationStrategy: PID 22853 died... 09:59:45.101364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22853): Terminated: ok {rc=0} 09:59:45.149033 --- ParallelTerminationStrategy: PID 22854 died... 09:59:45.169030 run iperf3-srv_10.42.42.10(pid=22854): Terminated {rc=256} 09:59:45.216832 --- ParallelTerminationStrategy: PID 22855 died... 09:59:45.237333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22855): Terminated: ok {rc=0} 09:59:45.284850 --- ParallelTerminationStrategy: PID 22856 died... 09:59:45.305262 run iperf3-srv_10.42.42.10(pid=22856): Terminated {rc=256} 09:59:45.352929 --- ParallelTerminationStrategy: PID 22859 died... 09:59:45.373248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22859): Terminated: ok {rc=0} 09:59:45.421094 --- ParallelTerminationStrategy: PID 22863 died... 09:59:45.441242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22863): Terminated: ok {rc=0} 09:59:45.488748 --- ParallelTerminationStrategy: PID 22866 died... 09:59:45.508628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22866): Terminated: ok {rc=0} 09:59:45.598691 bus /gobi_4: Setting Powered False 09:59:46.702881 bus /gobi_4: Setting Powered False 09:59:47.823272 bus /gobi_1: Setting Powered False 09:59:48.924195 bus /gobi_1: Setting Powered False 09:59:50.042568 bus /gobi_0: Setting Powered False 09:59:51.141527 bus /gobi_0: Setting Powered False 09:59:52.259020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:59:53.364270 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.376100 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:59:53.436809 tst ping.py: using LAC 20680 09:59:53.554621 tst ping.py: using RAC 25 09:59:53.672864 tst ping.py: using CellId 20680 09:59:53.789533 tst ping.py: using BVCI 20681 09:59:53.900552 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.911518 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.922249 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.932886 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.943502 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.954128 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.964847 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:59:53.975535 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:59:54.087862 tst ping.py:19: start network... 09:59:54.287518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:54.753172 run create_hlr_db(pid=22868): Launched 09:59:54.875648 bus /gobi_6: Setting Powered False 09:59:55.936386 run create_hlr_db(pid=22868): Terminated: ok {rc=0} 09:59:56.355976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22870): Launched 09:59:56.655880 run osmo-hlr_10.42.42.2(pid=22871): Launched 09:59:56.769723 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:57.288015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22873): Launched 09:59:57.587485 run osmo-stp_10.42.42.5(pid=22874): Launched 09:59:57.701579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:58.218884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22876): Launched 09:59:58.334949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:58.587797 run patchelf(pid=22877): Launched 09:59:58.755106 run osmo-stp_10.42.42.5(pid=22874): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22874)] 09:59:58.883343 run osmo-stp_10.42.42.5(pid=22874): stdout: | (launched: 2022-12-09_09:59:57.532091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:59.011865 run osmo-stp_10.42.42.5(pid=22874): stderr: | 20221209095957704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095957704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095957704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095957705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095957705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095957705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095957705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:59.140714 run osmo-stp_10.42.42.5(pid=22874): stdout: | (launched: 2022-12-09_09:59:57.532091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:59.264213 run osmo-stp_10.42.42.5(pid=22874): stderr: | 20221209095957704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209095957704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209095957704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209095957705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209095957705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209095957705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209095957705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:59.410369 run patchelf(pid=22877): Terminating (SIGINT) 09:59:59.578165 run patchelf(pid=22877): Terminated: ok {rc=0} 09:59:59.699474 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22874): Process ended prematurely: osmo-stp_10.42.42.5(pid=22874) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22874)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 09:59:59.708493 tst ping.py:22: Test FAILED (6.3 sec) 09:59:59.735548 run osmo-hlr_10.42.42.2(pid=22871): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22871)] 09:59:59.783941 run osmo-hlr_10.42.42.2(pid=22871): stdout: | (launched: 2022-12-09_09:59:56.600272) 09:59:59.834249 run osmo-hlr_10.42.42.2(pid=22871): stderr: | 20221209095956779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209095956779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209095956779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209095956779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209095956779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209095956779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209095956795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209095956805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209095956806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209095956806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:59.884608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22870): Terminating (SIGTERM) 09:59:59.925401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22873): Terminating (SIGTERM) 09:59:59.965894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22876): Terminating (SIGTERM) 10:00:00.006519 --- ParallelTerminationStrategy: PID 22870 died... 10:00:00.025932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22870): Terminated: ok {rc=0} 10:00:00.070800 --- ParallelTerminationStrategy: PID 22873 died... 10:00:00.089627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22873): Terminated: ok {rc=0} 10:00:00.134337 --- ParallelTerminationStrategy: PID 22876 died... 10:00:00.153395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22876): Terminated: ok {rc=0} 10:00:00.240263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:00:01.333461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:01.349582 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:00:01.421317 tst ping_idle_ping.py: using LAC 20681 10:00:01.552352 tst ping_idle_ping.py: using RAC 26 10:00:01.683383 tst ping_idle_ping.py: using CellId 20681 10:00:01.815823 tst ping_idle_ping.py: using BVCI 20682 10:00:01.968881 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:01.985888 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:02.004063 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:02.017689 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:02.030183 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:02.043142 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:02.056882 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:00:02.069870 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:00:02.228741 tst ping_idle_ping.py:24: start network... 10:00:02.474689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:02.989744 run create_hlr_db(pid=22888): Launched 10:00:03.116150 bus /gobi_6: Setting Powered False 10:00:04.180874 run create_hlr_db(pid=22888): Terminated: ok {rc=0} 10:00:04.634406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22890): Launched 10:00:04.960917 run osmo-hlr_10.42.42.2(pid=22891): Launched 10:00:05.087325 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:05.643719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22893): Launched 10:00:05.968850 run osmo-stp_10.42.42.5(pid=22894): Launched 10:00:06.094765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:06.655807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22896): Launched 10:00:06.781049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:07.054854 run patchelf(pid=22897): Launched 10:00:07.237157 run osmo-stp_10.42.42.5(pid=22894): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22894)] 10:00:07.375181 run osmo-stp_10.42.42.5(pid=22894): stdout: | (launched: 2022-12-09_10:00:05.909265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:07.514425 run osmo-stp_10.42.42.5(pid=22894): stderr: | 20221209100006103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100006103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100006103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100006104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100006106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100006106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100006107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:07.653410 run osmo-stp_10.42.42.5(pid=22894): stdout: | (launched: 2022-12-09_10:00:05.909265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:07.788751 run osmo-stp_10.42.42.5(pid=22894): stderr: | 20221209100006103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100006103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100006103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100006104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100006106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100006106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100006107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:07.946440 run patchelf(pid=22897): Terminating (SIGINT) 10:00:08.128547 run patchelf(pid=22897): Terminated: ok {rc=0} 10:00:08.259561 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22894): Process ended prematurely: osmo-stp_10.42.42.5(pid=22894) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22894)] [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:00:08.269430 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 10:00:08.298503 run osmo-hlr_10.42.42.2(pid=22891): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22891)] 10:00:08.350163 run osmo-hlr_10.42.42.2(pid=22891): stdout: | (launched: 2022-12-09_10:00:04.901560) 10:00:08.403734 run osmo-hlr_10.42.42.2(pid=22891): stderr: | 20221209100005100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100005100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100005100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100005101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100005101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100005101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100005113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100005122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100005122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100005122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:08.457864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22890): Terminating (SIGTERM) 10:00:08.500893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22893): Terminating (SIGTERM) 10:00:08.543930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22896): Terminating (SIGTERM) 10:00:08.587119 --- ParallelTerminationStrategy: PID 22890 died... 10:00:08.607657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22890): Terminated: ok {rc=0} 10:00:08.655401 --- ParallelTerminationStrategy: PID 22893 died... 10:00:08.675438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22893): Terminated: ok {rc=0} 10:00:08.723087 --- ParallelTerminationStrategy: PID 22896 died... 10:00:08.743196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22896): Terminated: ok {rc=0} 10:00:08.833037 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:00:10.120894 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:10.127956 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:00:10.149692 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:00:10.184514 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:00:10.239112 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:00:10.260104 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:00:10.295084 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:00:10.849611 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:00:10.854561 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:10.866022 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:00:10.922391 tst switch_tch_pdch.py: using LAC 20682 10:00:11.053066 tst switch_tch_pdch.py: using RAC 27 10:00:11.179312 tst switch_tch_pdch.py: using CellId 20682 10:00:11.307053 tst switch_tch_pdch.py: using BVCI 20683 10:00:11.426593 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.438518 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.450093 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.462204 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.474047 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.486800 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.498503 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:00:11.510463 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:00:11.632630 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:00:11.749233 tst switch_tch_pdch.py:51: start network... 10:00:11.949531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:12.418756 run create_hlr_db(pid=22902): Launched 10:00:12.544163 bus /gobi_6: Setting Powered False 10:00:13.613375 run create_hlr_db(pid=22902): Terminated: ok {rc=0} 10:00:14.075501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23096): Launched 10:00:14.409786 run osmo-hlr_10.42.42.2(pid=23173): Launched 10:00:14.549542 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:15.198168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23258): Launched 10:00:15.520819 run osmo-stp_10.42.42.5(pid=23259): Launched 10:00:15.644587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:16.233934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23261): Launched 10:00:16.354874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:16.623551 run patchelf(pid=23262): Launched 10:00:16.817380 run osmo-stp_10.42.42.5(pid=23259): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23259)] 10:00:16.958429 run osmo-stp_10.42.42.5(pid=23259): stdout: | (launched: 2022-12-09_10:00:15.461477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:17.100668 run osmo-stp_10.42.42.5(pid=23259): stderr: | 20221209100015656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100015656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100015656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100015657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100015657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100015658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100015658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:17.242355 run osmo-stp_10.42.42.5(pid=23259): stdout: | (launched: 2022-12-09_10:00:15.461477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:17.375532 run osmo-stp_10.42.42.5(pid=23259): stderr: | 20221209100015656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100015656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100015656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100015657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100015657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100015658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100015658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:17.533194 run patchelf(pid=23262): Terminating (SIGINT) 10:00:17.714740 run patchelf(pid=23262): Terminated: ok {rc=0} 10:00:17.845409 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23259): Process ended prematurely: osmo-stp_10.42.42.5(pid=23259) [trial-2358↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23259)] [trial-2358↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:00:17.855297 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 10:00:17.884789 run osmo-hlr_10.42.42.2(pid=23173): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23173)] 10:00:17.936685 run osmo-hlr_10.42.42.2(pid=23173): stdout: | (launched: 2022-12-09_10:00:14.347920) 10:00:17.990046 run osmo-hlr_10.42.42.2(pid=23173): stderr: | 20221209100014718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100014718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100014718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100014718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100014718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100014718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100014744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100014762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100014762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100014762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:18.044167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23096): Terminating (SIGTERM) 10:00:18.087832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23258): Terminating (SIGTERM) 10:00:18.131499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23261): Terminating (SIGTERM) 10:00:18.175272 --- ParallelTerminationStrategy: PID 23096 died... 10:00:18.195977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23096): Terminated: ok {rc=0} 10:00:18.243975 --- ParallelTerminationStrategy: PID 23258 died... 10:00:18.264087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23258): Terminated: ok {rc=0} 10:00:18.311491 --- ParallelTerminationStrategy: PID 23261 died... 10:00:18.331505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23261): Terminated: ok {rc=0} 10:00:18.421633 bus /gobi_0: Setting Powered False 10:00:19.519905 bus /gobi_0: Setting Powered False 10:00:20.636309 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:00:21.870004 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:21.875776 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:00:21.896404 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:00:21.930888 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:00:21.983325 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:00:22.003887 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:00:22.037916 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:00:22.594813 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:00:22.600384 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:22.614406 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:00:22.670417 tst switch_tch_pdch.py: using LAC 20683 10:00:22.788626 tst switch_tch_pdch.py: using RAC 28 10:00:22.908641 tst switch_tch_pdch.py: using CellId 20683 10:00:23.037458 tst switch_tch_pdch.py: using BVCI 20684 10:00:23.159348 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.170893 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.182899 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.195340 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.206879 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.218520 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.230597 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:00:23.242140 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:00:23.364050 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:00:23.482241 tst switch_tch_pdch.py:51: start network... 10:00:23.689794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:24.144466 run create_hlr_db(pid=23431): Launched 10:00:24.281644 bus /gobi_6: Setting Powered False 10:00:25.346107 run create_hlr_db(pid=23431): Terminated: ok {rc=0} 10:00:25.778075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23443): Launched 10:00:26.118025 run osmo-hlr_10.42.42.2(pid=23444): Launched 10:00:26.368511 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:27.010145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23446): Launched 10:00:27.350104 run osmo-stp_10.42.42.5(pid=23447): Launched 10:00:27.599398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:28.219982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23449): Launched 10:00:28.358469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:28.644156 run patchelf(pid=23450): Launched 10:00:28.844752 run osmo-stp_10.42.42.5(pid=23447): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23447)] 10:00:28.985726 run osmo-stp_10.42.42.5(pid=23447): stdout: | (launched: 2022-12-09_10:00:27.290811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:29.132683 run osmo-stp_10.42.42.5(pid=23447): stderr: | 20221209100027583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100027583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100027583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100027584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100027584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100027584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100027584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:29.278068 run osmo-stp_10.42.42.5(pid=23447): stdout: | (launched: 2022-12-09_10:00:27.290811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:29.415417 run osmo-stp_10.42.42.5(pid=23447): stderr: | 20221209100027583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100027583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100027583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100027584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100027584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100027584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100027584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:29.574646 run patchelf(pid=23450): Terminating (SIGINT) 10:00:29.756806 run patchelf(pid=23450): Terminated: ok {rc=0} 10:00:29.888798 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23447): Process ended prematurely: osmo-stp_10.42.42.5(pid=23447) [trial-2358↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23447)] [trial-2358↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:00:29.899039 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 10:00:29.928503 run osmo-hlr_10.42.42.2(pid=23444): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23444)] 10:00:29.980414 run osmo-hlr_10.42.42.2(pid=23444): stdout: | (launched: 2022-12-09_10:00:26.058934) 10:00:30.034441 run osmo-hlr_10.42.42.2(pid=23444): stderr: | 20221209100026360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100026360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100026360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100026360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100026360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100026360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100026384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100026397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100026397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100026397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:30.088933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23443): Terminating (SIGTERM) 10:00:30.132279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23446): Terminating (SIGTERM) 10:00:30.175515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23449): Terminating (SIGTERM) 10:00:30.219105 --- ParallelTerminationStrategy: PID 23443 died... 10:00:30.239447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23443): Terminated: ok {rc=0} 10:00:30.287613 --- ParallelTerminationStrategy: PID 23446 died... 10:00:30.307829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23446): Terminated: ok {rc=0} 10:00:30.355766 --- ParallelTerminationStrategy: PID 23449 died... 10:00:30.375973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23449): Terminated: ok {rc=0} 10:00:30.465818 bus /gobi_0: Setting Powered False 10:00:31.565068 bus /gobi_0: Setting Powered False 10:00:32.683719 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:oc2g --------------------------------------------------------------------- 10:00:33.920789 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:33.924579 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 10:00:33.944784 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 10:00:33.951764 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 10:00:34.003772 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 10:00:34.024822 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 10:00:34.032801 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 10:00:34.571644 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 10:00:34.577126 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 10:00:34.588216 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 10:00:34.623432 tst mo_mt_sms.py: using LAC 20684 10:00:34.753551 tst mo_mt_sms.py: using RAC 29 10:00:34.884575 tst mo_mt_sms.py: using CellId 20684 10:00:35.012123 tst mo_mt_sms.py: using BVCI 20685 10:00:35.130891 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 10:00:35.246639 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 10:00:35.364816 tst mo_mt_sms.py:9: start nitb and bts... 10:00:35.582315 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:00:36.241901 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23455): Launched 10:00:36.568322 run osmo-nitb_10.42.42.2(pid=23456): Launched 10:00:36.748006 run osmo-nitb_10.42.42.2(pid=23456): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23456)] 10:00:36.893408 run osmo-nitb_10.42.42.2(pid=23456): stdout: | (launched: 2022-12-09_10:00:36.508670) 10:00:37.040007 run osmo-nitb_10.42.42.2(pid=23456): stderr: | (launched: 2022-12-09_10:00:36.557179) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:00:37.187339 run osmo-nitb_10.42.42.2(pid=23456): stdout: | (launched: 2022-12-09_10:00:36.508670) 10:00:37.328817 run osmo-nitb_10.42.42.2(pid=23456): stderr: | (launched: 2022-12-09_10:00:36.557179) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23456): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23456) [trial-2358↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23456)] 10:00:37.690815 tst osmo-nitb_10.42.42.2(pid=23456): stdout: | (launched: 2022-12-09_10:00:36.508670) 10:00:37.822473 tst osmo-nitb_10.42.42.2(pid=23456): stderr: | (launched: 2022-12-09_10:00:36.557179) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:00:37.977005 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23456): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23456) [trial-2358↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23456)] [trial-2358↪nitb_sms:oc2g↪mo_mt_sms.py:11] 10:00:37.986610 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:00:37.994140 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23455): Terminating (SIGTERM) 10:00:38.206362 --- ParallelTerminationStrategy: PID 23455 died... 10:00:38.228494 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23455): Terminated: ok {rc=0} 10:00:38.318455 bus /sierra_3: Setting Powered False 10:00:39.419654 bus /sierra_3: Setting Powered False 10:00:40.536042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:oc2g --------------------------------------------------------------------- 10:00:41.716638 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:41.720693 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 10:00:41.740998 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 10:00:41.767139 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 10:00:41.819725 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 10:00:41.840382 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 10:00:41.866630 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 10:00:42.409961 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:oc2g mo_mt_sms.py ---------------------------------------------- 10:00:42.414832 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:00:42.425309 tst sms:oc2g: Using 1 x bts (candidates: 1) 10:00:42.458453 tst mo_mt_sms.py: using LAC 20685 10:00:42.576735 tst mo_mt_sms.py: using RAC 30 10:00:42.700747 tst mo_mt_sms.py: using CellId 20685 10:00:42.818468 tst mo_mt_sms.py: using BVCI 20686 10:00:42.928663 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:00:42.939234 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:00:42.949655 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:00:42.959977 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:00:42.970338 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:00:42.980517 tst sms:oc2g: Using 1 x modem (candidates: 2) 10:00:43.098237 tst sms:oc2g: Using 1 x modem (candidates: 2) 10:00:43.215275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:43.683648 run create_hlr_db(pid=23461): Launched 10:00:43.806033 bus /sierra_2: Setting Powered False 10:00:44.866500 run create_hlr_db(pid=23461): Terminated: ok {rc=0} 10:00:45.309678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23463): Launched 10:00:45.632712 run osmo-hlr_10.42.42.2(pid=23464): Launched 10:00:45.755555 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:46.400326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23466): Launched 10:00:46.768043 run osmo-stp_10.42.42.5(pid=23467): Launched 10:00:47.016859 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:47.670625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23469): Launched 10:00:47.994024 run osmo-msc_10.42.42.6(pid=23470): Launched 10:00:48.177313 run osmo-stp_10.42.42.5(pid=23467): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23467)] 10:00:48.314599 run osmo-stp_10.42.42.5(pid=23467): stdout: | (launched: 2022-12-09_10:00:46.708548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:48.452098 run osmo-stp_10.42.42.5(pid=23467): stderr: | 20221209100047008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100047008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100047008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100047008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100047009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100047009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100047009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:48.589248 run osmo-stp_10.42.42.5(pid=23467): stdout: | (launched: 2022-12-09_10:00:46.708548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:48.717888 run osmo-stp_10.42.42.5(pid=23467): stderr: | 20221209100047008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100047008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100047008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100047008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100047009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100047009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100047009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:48.871791 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23467): Process ended prematurely: osmo-stp_10.42.42.5(pid=23467) [trial-2358↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23467)] [trial-2358↪sms:oc2g↪mo_mt_sms.py:16] 10:00:48.881176 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 10:00:48.909561 run osmo-hlr_10.42.42.2(pid=23464): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23464)] 10:00:48.960578 run osmo-hlr_10.42.42.2(pid=23464): stdout: | (launched: 2022-12-09_10:00:45.573356) 10:00:49.013559 run osmo-hlr_10.42.42.2(pid=23464): stderr: | 20221209100045772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100045772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100045772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100045772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100045772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100045772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100045784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100045793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100045793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100045793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:49.087544 run osmo-msc_10.42.42.6(pid=23470): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23470)] 10:00:49.138833 run osmo-msc_10.42.42.6(pid=23470): stdout: | (launched: 2022-12-09_10:00:47.934581) 10:00:49.191804 run osmo-msc_10.42.42.6(pid=23470): stderr: | 20221209100048256 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100048256 DLGLOBAL DEBUG validating counter group 0x7f872a67dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100048257 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100048257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100048257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100048257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100048260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100048261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100048261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100048261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:49.245386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23463): Terminating (SIGTERM) 10:00:49.288230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23466): Terminating (SIGTERM) 10:00:49.331101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23469): Terminating (SIGTERM) 10:00:49.374200 --- ParallelTerminationStrategy: PID 23463 died... 10:00:49.394553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23463): Terminated: ok {rc=0} 10:00:49.442105 --- ParallelTerminationStrategy: PID 23466 died... 10:00:49.461968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23466): Terminated: ok {rc=0} 10:00:49.509406 --- ParallelTerminationStrategy: PID 23469 died... 10:00:49.529249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23469): Terminated: ok {rc=0} 10:00:49.619064 bus /sierra_3: Setting Powered False 10:00:50.719823 bus /sierra_3: Setting Powered False 10:00:51.838568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:oc2g --------------------------------------------------------------------- 10:00:53.054767 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:53.059138 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 10:00:53.080832 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 10:00:53.088310 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 10:00:53.125339 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 10:00:53.146703 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 10:00:53.154027 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 10:00:53.672876 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 10:00:53.678732 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 10:00:53.690247 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 10:00:53.724810 tst assert_extension.py: using LAC 20686 10:00:53.851092 tst assert_extension.py: using RAC 31 10:00:53.982473 tst assert_extension.py: using CellId 20686 10:00:54.109583 tst assert_extension.py: using BVCI 20687 10:00:54.227192 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 10:00:54.341284 tst assert_extension.py:10: start nitb and bts... 10:00:54.541485 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:00:55.155962 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23475): Launched 10:00:55.458469 run osmo-nitb_10.42.42.2(pid=23476): Launched 10:00:55.626766 run osmo-nitb_10.42.42.2(pid=23476): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23476)] 10:00:55.761308 run osmo-nitb_10.42.42.2(pid=23476): stdout: | (launched: 2022-12-09_10:00:55.402509) 10:00:55.897038 run osmo-nitb_10.42.42.2(pid=23476): stderr: | (launched: 2022-12-09_10:00:55.447212) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:00:56.032854 run osmo-nitb_10.42.42.2(pid=23476): stdout: | (launched: 2022-12-09_10:00:55.402509) 10:00:56.163584 run osmo-nitb_10.42.42.2(pid=23476): stderr: | (launched: 2022-12-09_10:00:55.447212) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23476): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23476) [trial-2358↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23476)] 10:00:56.573878 tst osmo-nitb_10.42.42.2(pid=23476): stdout: | (launched: 2022-12-09_10:00:55.402509) 10:00:56.694394 tst osmo-nitb_10.42.42.2(pid=23476): stderr: | (launched: 2022-12-09_10:00:55.447212) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:00:56.837133 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23476): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23476) [trial-2358↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23476)] [trial-2358↪nitb_ussd:oc2g↪assert_extension.py:12] 10:00:56.845451 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:00:56.852165 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23475): Terminating (SIGTERM) 10:00:57.061523 --- ParallelTerminationStrategy: PID 23475 died... 10:00:57.082040 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23475): Terminated: ok {rc=0} 10:00:57.167197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:oc2g --------------------------------------------------------------------- 10:00:58.327145 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:58.330915 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 10:00:58.351085 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 10:00:58.377291 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 10:00:58.413054 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 10:00:58.433323 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 10:00:58.459345 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 10:00:58.989474 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:oc2g assert_extension.py ---------------------------------------------- 10:00:58.995390 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:00:59.006613 tst ussd:oc2g: Using 1 x bts (candidates: 1) 10:00:59.041988 tst assert_extension.py: using LAC 20687 10:00:59.171179 tst assert_extension.py: using RAC 32 10:00:59.298979 tst assert_extension.py: using CellId 20687 10:00:59.431362 tst assert_extension.py: using BVCI 20688 10:00:59.550163 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:00:59.561380 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:00:59.572379 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:00:59.583426 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:00:59.594857 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:00:59.606021 tst ussd:oc2g: Using 1 x modem (candidates: 1) 10:00:59.720497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:00.187125 run create_hlr_db(pid=23481): Launched 10:01:00.314066 bus /sierra_2: Setting Powered False 10:01:01.376360 run create_hlr_db(pid=23481): Terminated: ok {rc=0} 10:01:01.865577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23483): Launched 10:01:02.206109 run osmo-hlr_10.42.42.2(pid=23484): Launched 10:01:02.344326 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:02.871363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23486): Launched 10:01:03.174448 run osmo-stp_10.42.42.5(pid=23487): Launched 10:01:03.291955 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:03.836592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23489): Launched 10:01:04.137079 run osmo-msc_10.42.42.6(pid=23490): Launched 10:01:04.305433 run osmo-stp_10.42.42.5(pid=23487): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23487)] 10:01:04.433731 run osmo-stp_10.42.42.5(pid=23487): stdout: | (launched: 2022-12-09_10:01:03.118517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:04.562939 run osmo-stp_10.42.42.5(pid=23487): stderr: | 20221209100103289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100103289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100103289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100103290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100103290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100103290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100103290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:04.688524 run osmo-stp_10.42.42.5(pid=23487): stdout: | (launched: 2022-12-09_10:01:03.118517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:04.808331 run osmo-stp_10.42.42.5(pid=23487): stderr: | 20221209100103289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100103289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100103289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100103290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100103290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100103290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100103290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:04.951346 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23487): Process ended prematurely: osmo-stp_10.42.42.5(pid=23487) [trial-2358↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23487)] [trial-2358↪ussd:oc2g↪assert_extension.py:17] 10:01:04.959703 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:01:04.986254 run osmo-hlr_10.42.42.2(pid=23484): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23484)] 10:01:05.034698 run osmo-hlr_10.42.42.2(pid=23484): stdout: | (launched: 2022-12-09_10:01:02.146314) 10:01:05.084665 run osmo-hlr_10.42.42.2(pid=23484): stderr: | 20221209100102344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100102344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100102344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100102344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100102344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100102344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100102370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100102380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100102381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100102381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:05.154228 run osmo-msc_10.42.42.6(pid=23490): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23490)] 10:01:05.202636 run osmo-msc_10.42.42.6(pid=23490): stdout: | (launched: 2022-12-09_10:01:04.080938) 10:01:05.252813 run osmo-msc_10.42.42.6(pid=23490): stderr: | 20221209100104355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100104356 DLGLOBAL DEBUG validating counter group 0x7fe9ff012c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100104356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100104356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100104356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100104356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100104358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100104358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100104358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100104359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:05.303841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23483): Terminating (SIGTERM) 10:01:05.344337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23486): Terminating (SIGTERM) 10:01:05.384491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23489): Terminating (SIGTERM) 10:01:05.425043 --- ParallelTerminationStrategy: PID 23483 died... 10:01:05.444305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23483): Terminated: ok {rc=0} 10:01:05.488735 --- ParallelTerminationStrategy: PID 23486 died... 10:01:05.507732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23486): Terminated: ok {rc=0} 10:01:05.551827 --- ParallelTerminationStrategy: PID 23489 died... 10:01:05.570713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23489): Terminated: ok {rc=0} 10:01:05.655741 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:01:06.851576 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:06.858621 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:01:06.880440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:01:06.908193 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:01:06.962268 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:01:06.984011 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:01:07.011858 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:01:07.560208 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:01:07.614296 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:07.625916 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:01:07.687500 tst mo_mt_call.py: using LAC 20688 10:01:07.816279 tst mo_mt_call.py: using RAC 33 10:01:07.943609 tst mo_mt_call.py: using CellId 20688 10:01:08.071199 tst mo_mt_call.py: using BVCI 20689 10:01:08.191590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:08.203163 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:08.214384 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:08.225944 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:08.237738 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:08.249387 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:01:08.367440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:01:08.487636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:08.998775 run create_hlr_db(pid=23495): Launched 10:01:09.138289 bus /sierra_2: Setting Powered False 10:01:10.203176 run create_hlr_db(pid=23495): Terminated: ok {rc=0} 10:01:10.642109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23497): Launched 10:01:10.947962 run osmo-hlr_10.42.42.2(pid=23498): Launched 10:01:11.064804 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:11.591660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23500): Launched 10:01:11.897732 run osmo-stp_10.42.42.5(pid=23501): Launched 10:01:12.015658 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:12.573675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23503): Launched 10:01:12.879326 run osmo-msc_10.42.42.6(pid=23504): Launched 10:01:13.050695 run osmo-stp_10.42.42.5(pid=23501): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23501)] 10:01:13.179877 run osmo-stp_10.42.42.5(pid=23501): stdout: | (launched: 2022-12-09_10:01:11.840921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:13.309249 run osmo-stp_10.42.42.5(pid=23501): stderr: | 20221209100112013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100112013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100112013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100112014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100112014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100112014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100112014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:13.437175 run osmo-stp_10.42.42.5(pid=23501): stdout: | (launched: 2022-12-09_10:01:11.840921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:13.558724 run osmo-stp_10.42.42.5(pid=23501): stderr: | 20221209100112013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100112013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100112013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100112014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100112014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100112014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100112014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:13.704524 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23501): Process ended prematurely: osmo-stp_10.42.42.5(pid=23501) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23501)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:01:13.713560 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:01:13.740355 run osmo-hlr_10.42.42.2(pid=23498): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23498)] 10:01:13.788897 run osmo-hlr_10.42.42.2(pid=23498): stdout: | (launched: 2022-12-09_10:01:10.891730) 10:01:13.838935 run osmo-hlr_10.42.42.2(pid=23498): stderr: | 20221209100111070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100111070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100111070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100111070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100111070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100111070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100111107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100111118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100111118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100111118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:13.908359 run osmo-msc_10.42.42.6(pid=23504): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23504)] 10:01:13.956452 run osmo-msc_10.42.42.6(pid=23504): stdout: | (launched: 2022-12-09_10:01:12.822524) 10:01:14.006106 run osmo-msc_10.42.42.6(pid=23504): stderr: | 20221209100113094 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100113095 DLGLOBAL DEBUG validating counter group 0x7f0d057c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100113095 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100113095 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100113095 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100113095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100113097 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100113097 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100113097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100113098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:14.056300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23497): Terminating (SIGTERM) 10:01:14.096211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23500): Terminating (SIGTERM) 10:01:14.136040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23503): Terminating (SIGTERM) 10:01:14.176177 --- ParallelTerminationStrategy: PID 23497 died... 10:01:14.195304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23497): Terminated: ok {rc=0} 10:01:14.239336 --- ParallelTerminationStrategy: PID 23500 died... 10:01:14.258144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23500): Terminated: ok {rc=0} 10:01:14.302216 --- ParallelTerminationStrategy: PID 23503 died... 10:01:14.321049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23503): Terminated: ok {rc=0} 10:01:14.407782 bus /sierra_3: Setting Powered False 10:01:15.508995 bus /sierra_3: Setting Powered False 10:01:16.639963 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:01:17.805188 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:17.817529 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:01:17.880541 tst mo_mt_call_osmux.py: using LAC 20689 10:01:18.009675 tst mo_mt_call_osmux.py: using RAC 34 10:01:18.139605 tst mo_mt_call_osmux.py: using CellId 20689 10:01:18.267268 tst mo_mt_call_osmux.py: using BVCI 20690 10:01:18.389408 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:18.400929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:18.412457 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:18.424147 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:18.435900 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:01:18.447748 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:01:18.567073 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:01:18.686823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:19.199248 run create_hlr_db(pid=23506): Launched 10:01:19.325925 bus /sierra_2: Setting Powered False 10:01:20.391113 run create_hlr_db(pid=23506): Terminated: ok {rc=0} 10:01:20.848484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23508): Launched 10:01:21.179180 run osmo-hlr_10.42.42.2(pid=23509): Launched 10:01:21.305531 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:21.877249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23511): Launched 10:01:22.207919 run osmo-stp_10.42.42.5(pid=23512): Launched 10:01:22.335005 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:22.933687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23514): Launched 10:01:23.266113 run osmo-msc_10.42.42.6(pid=23515): Launched 10:01:23.451173 run osmo-stp_10.42.42.5(pid=23512): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23512)] 10:01:23.590043 run osmo-stp_10.42.42.5(pid=23512): stdout: | (launched: 2022-12-09_10:01:22.147694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:23.729212 run osmo-stp_10.42.42.5(pid=23512): stderr: | 20221209100122338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100122338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100122339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100122339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100122339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100122340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100122340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:23.866580 run osmo-stp_10.42.42.5(pid=23512): stdout: | (launched: 2022-12-09_10:01:22.147694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:23.997995 run osmo-stp_10.42.42.5(pid=23512): stderr: | 20221209100122338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100122338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100122339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100122339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100122339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100122340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100122340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:24.155841 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23512): Process ended prematurely: osmo-stp_10.42.42.5(pid=23512) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23512)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:01:24.165747 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:01:24.194740 run osmo-hlr_10.42.42.2(pid=23509): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23509)] 10:01:24.246018 run osmo-hlr_10.42.42.2(pid=23509): stdout: | (launched: 2022-12-09_10:01:21.118541) 10:01:24.298917 run osmo-hlr_10.42.42.2(pid=23509): stderr: | 20221209100121318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100121318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100121318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100121318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100121318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100121318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100121332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100121340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100121340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100121340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:24.372140 run osmo-msc_10.42.42.6(pid=23515): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23515)] 10:01:24.423344 run osmo-msc_10.42.42.6(pid=23515): stdout: | (launched: 2022-12-09_10:01:23.205426) 10:01:24.476225 run osmo-msc_10.42.42.6(pid=23515): stderr: | 20221209100123531 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100123531 DLGLOBAL DEBUG validating counter group 0x7fe543de8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100123531 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100123531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100123531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100123531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100123533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100123533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100123534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100123534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:24.529792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23508): Terminating (SIGTERM) 10:01:24.572393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23511): Terminating (SIGTERM) 10:01:24.615125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23514): Terminating (SIGTERM) 10:01:24.658129 --- ParallelTerminationStrategy: PID 23508 died... 10:01:24.678557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23508): Terminated: ok {rc=0} 10:01:24.726158 --- ParallelTerminationStrategy: PID 23511 died... 10:01:24.746250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23511): Terminated: ok {rc=0} 10:01:24.793624 --- ParallelTerminationStrategy: PID 23514 died... 10:01:24.813675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23514): Terminated: ok {rc=0} 10:01:24.903305 bus /sierra_3: Setting Powered False 10:01:26.004016 bus /sierra_3: Setting Powered False 10:01:27.123585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:01:28.357258 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:28.363621 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:01:28.383946 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:01:28.410358 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:01:28.464173 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:01:28.485315 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:01:28.511461 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:01:29.057839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:01:29.106648 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:29.117706 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:01:29.173438 tst mo_mt_call.py: using LAC 20690 10:01:29.294524 tst mo_mt_call.py: using RAC 35 10:01:29.419902 tst mo_mt_call.py: using CellId 20690 10:01:29.539572 tst mo_mt_call.py: using BVCI 20691 10:01:29.651967 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:29.662995 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:29.673852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:29.684539 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:29.695332 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:29.706147 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:01:29.823625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:01:29.940193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:30.417674 run create_hlr_db(pid=23520): Launched 10:01:30.544038 bus /sierra_2: Setting Powered False 10:01:31.605749 run create_hlr_db(pid=23520): Terminated: ok {rc=0} 10:01:32.046179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23522): Launched 10:01:32.367666 run osmo-hlr_10.42.42.2(pid=23523): Launched 10:01:32.485486 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:33.014880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23525): Launched 10:01:33.321303 run osmo-stp_10.42.42.5(pid=23526): Launched 10:01:33.438056 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:33.999233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23528): Launched 10:01:34.305530 run osmo-msc_10.42.42.6(pid=23529): Launched 10:01:34.478653 run osmo-stp_10.42.42.5(pid=23526): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23526)] 10:01:34.609204 run osmo-stp_10.42.42.5(pid=23526): stdout: | (launched: 2022-12-09_10:01:33.264705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:34.740230 run osmo-stp_10.42.42.5(pid=23526): stderr: | 20221209100133436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100133436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100133436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100133437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100133437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100133437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100133437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:34.869103 run osmo-stp_10.42.42.5(pid=23526): stdout: | (launched: 2022-12-09_10:01:33.264705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:34.992169 run osmo-stp_10.42.42.5(pid=23526): stderr: | 20221209100133436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100133436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100133436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100133437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100133437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100133437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100133437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:35.139376 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23526): Process ended prematurely: osmo-stp_10.42.42.5(pid=23526) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23526)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:01:35.148549 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:01:35.175253 run osmo-hlr_10.42.42.2(pid=23523): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23523)] 10:01:35.223858 run osmo-hlr_10.42.42.2(pid=23523): stdout: | (launched: 2022-12-09_10:01:32.310486) 10:01:35.274002 run osmo-hlr_10.42.42.2(pid=23523): stderr: | 20221209100132485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100132485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100132485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100132485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100132485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100132486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100132499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100132507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100132507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100132507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:35.343901 run osmo-msc_10.42.42.6(pid=23529): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23529)] 10:01:35.392409 run osmo-msc_10.42.42.6(pid=23529): stdout: | (launched: 2022-12-09_10:01:34.248837) 10:01:35.442503 run osmo-msc_10.42.42.6(pid=23529): stderr: | 20221209100134522 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100134522 DLGLOBAL DEBUG validating counter group 0x7f00b0d9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100134522 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100134522 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100134523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100134523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100134525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100134525 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100134525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100134525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:35.493028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23522): Terminating (SIGTERM) 10:01:35.533268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23525): Terminating (SIGTERM) 10:01:35.573714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23528): Terminating (SIGTERM) 10:01:35.614206 --- ParallelTerminationStrategy: PID 23522 died... 10:01:35.633486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23522): Terminated: ok {rc=0} 10:01:35.678129 --- ParallelTerminationStrategy: PID 23525 died... 10:01:35.697226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23525): Terminated: ok {rc=0} 10:01:35.741838 --- ParallelTerminationStrategy: PID 23528 died... 10:01:35.760824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23528): Terminated: ok {rc=0} 10:01:35.845592 bus /sierra_3: Setting Powered False 10:01:36.945947 bus /sierra_3: Setting Powered False 10:01:38.062905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:01:39.215772 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:39.228088 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:01:39.286482 tst mo_mt_call_osmux.py: using LAC 20691 10:01:39.417302 tst mo_mt_call_osmux.py: using RAC 36 10:01:39.548690 tst mo_mt_call_osmux.py: using CellId 20691 10:01:39.680386 tst mo_mt_call_osmux.py: using BVCI 20692 10:01:39.800710 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:39.812222 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:39.823437 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:39.834826 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:39.846134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:01:39.858003 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:01:39.978516 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:01:40.097211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:40.577201 run create_hlr_db(pid=23531): Launched 10:01:40.703372 bus /sierra_2: Setting Powered False 10:01:41.764166 run create_hlr_db(pid=23531): Terminated: ok {rc=0} 10:01:42.212753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23533): Launched 10:01:42.543129 run osmo-hlr_10.42.42.2(pid=23534): Launched 10:01:42.669320 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:43.242552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23536): Launched 10:01:43.572201 run osmo-stp_10.42.42.5(pid=23537): Launched 10:01:43.698959 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:44.295854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23539): Launched 10:01:44.608680 run osmo-msc_10.42.42.6(pid=23540): Launched 10:01:44.780219 run osmo-stp_10.42.42.5(pid=23537): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23537)] 10:01:44.910790 run osmo-stp_10.42.42.5(pid=23537): stdout: | (launched: 2022-12-09_10:01:43.511604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:45.040329 run osmo-stp_10.42.42.5(pid=23537): stderr: | 20221209100143705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100143705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100143705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100143706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100143706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100143706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100143706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:45.168316 run osmo-stp_10.42.42.5(pid=23537): stdout: | (launched: 2022-12-09_10:01:43.511604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:45.290555 run osmo-stp_10.42.42.5(pid=23537): stderr: | 20221209100143705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100143705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100143705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100143706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100143706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100143706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100143706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:45.436259 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23537): Process ended prematurely: osmo-stp_10.42.42.5(pid=23537) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23537)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:01:45.445338 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:01:45.472000 run osmo-hlr_10.42.42.2(pid=23534): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23534)] 10:01:45.519973 run osmo-hlr_10.42.42.2(pid=23534): stdout: | (launched: 2022-12-09_10:01:42.482118) 10:01:45.569696 run osmo-hlr_10.42.42.2(pid=23534): stderr: | 20221209100142683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100142683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100142683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100142683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100142683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100142683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100142696 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100142704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100142705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100142705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:45.639657 run osmo-msc_10.42.42.6(pid=23540): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23540)] 10:01:45.687800 run osmo-msc_10.42.42.6(pid=23540): stdout: | (launched: 2022-12-09_10:01:44.551972) 10:01:45.737345 run osmo-msc_10.42.42.6(pid=23540): stderr: | 20221209100144825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100144825 DLGLOBAL DEBUG validating counter group 0x7fac22d0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100144825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100144825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100144825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100144825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100144827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100144828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100144828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100144828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:45.787314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23533): Terminating (SIGTERM) 10:01:45.827836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23536): Terminating (SIGTERM) 10:01:45.883675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23539): Terminating (SIGTERM) 10:01:45.926722 --- ParallelTerminationStrategy: PID 23533 died... 10:01:45.946310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23533): Terminated: ok {rc=0} 10:01:45.992464 --- ParallelTerminationStrategy: PID 23536 died... 10:01:46.011700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23536): Terminated: ok {rc=0} 10:01:46.056596 --- ParallelTerminationStrategy: PID 23539 died... 10:01:46.075759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23539): Terminated: ok {rc=0} 10:01:46.160869 bus /sierra_3: Setting Powered False 10:01:47.255436 bus /sierra_3: Setting Powered False 10:01:48.371761 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:01:49.610216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:49.616284 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:01:49.636691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:01:49.663436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:01:49.714553 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:01:49.734859 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:01:49.761016 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:01:50.310739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:01:50.359711 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:01:50.370710 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:01:50.429490 tst mo_mt_call.py: using LAC 20692 10:01:50.550017 tst mo_mt_call.py: using RAC 37 10:01:50.669401 tst mo_mt_call.py: using CellId 20692 10:01:50.790600 tst mo_mt_call.py: using BVCI 20693 10:01:50.903658 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:01:50.914688 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:01:50.925499 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:01:50.936236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:01:50.947077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:01:50.957918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:01:51.074646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:01:51.190663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:51.670496 run create_hlr_db(pid=23545): Launched 10:01:51.796446 bus /sierra_2: Setting Powered False 10:01:52.857915 run create_hlr_db(pid=23545): Terminated: ok {rc=0} 10:01:53.284906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23547): Launched 10:01:53.591698 run osmo-hlr_10.42.42.2(pid=23548): Launched 10:01:53.709428 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:54.253937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23550): Launched 10:01:54.559678 run osmo-stp_10.42.42.5(pid=23551): Launched 10:01:54.676836 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:55.231063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23553): Launched 10:01:55.539384 run osmo-msc_10.42.42.6(pid=23554): Launched 10:01:55.711603 run osmo-stp_10.42.42.5(pid=23551): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23551)] 10:01:55.840843 run osmo-stp_10.42.42.5(pid=23551): stdout: | (launched: 2022-12-09_10:01:54.502911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:55.969719 run osmo-stp_10.42.42.5(pid=23551): stderr: | 20221209100154673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100154673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100154673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100154674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100154674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100154674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100154674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:56.097072 run osmo-stp_10.42.42.5(pid=23551): stdout: | (launched: 2022-12-09_10:01:54.502911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:56.219072 run osmo-stp_10.42.42.5(pid=23551): stderr: | 20221209100154673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100154673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100154673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100154674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100154674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100154674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100154674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:56.364790 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23551): Process ended prematurely: osmo-stp_10.42.42.5(pid=23551) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23551)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:01:56.373863 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:01:56.400518 run osmo-hlr_10.42.42.2(pid=23548): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23548)] 10:01:56.448431 run osmo-hlr_10.42.42.2(pid=23548): stdout: | (launched: 2022-12-09_10:01:53.534817) 10:01:56.498067 run osmo-hlr_10.42.42.2(pid=23548): stderr: | 20221209100153713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100153713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100153713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100153713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100153713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100153713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100153728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100153738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100153738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100153738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:56.567610 run osmo-msc_10.42.42.6(pid=23554): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23554)] 10:01:56.615593 run osmo-msc_10.42.42.6(pid=23554): stdout: | (launched: 2022-12-09_10:01:55.482357) 10:01:56.665282 run osmo-msc_10.42.42.6(pid=23554): stderr: | 20221209100155756 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100155756 DLGLOBAL DEBUG validating counter group 0x7f77e8655c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100155756 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100155756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100155756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100155756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100155758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100155758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100155759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100155759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:56.715550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23547): Terminating (SIGTERM) 10:01:56.755290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23550): Terminating (SIGTERM) 10:01:56.795062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23553): Terminating (SIGTERM) 10:01:56.835064 --- ParallelTerminationStrategy: PID 23547 died... 10:01:56.854169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23547): Terminated: ok {rc=0} 10:01:56.898766 --- ParallelTerminationStrategy: PID 23550 died... 10:01:56.917454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23550): Terminated: ok {rc=0} 10:01:56.961397 --- ParallelTerminationStrategy: PID 23553 died... 10:01:56.980029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23553): Terminated: ok {rc=0} 10:01:57.066000 bus /sierra_3: Setting Powered False 10:01:58.169576 bus /sierra_3: Setting Powered False 10:01:59.286530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:02:00.437716 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:02:00.450105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:02:00.508764 tst mo_mt_call_osmux.py: using LAC 20693 10:02:00.639726 tst mo_mt_call_osmux.py: using RAC 38 10:02:00.769176 tst mo_mt_call_osmux.py: using CellId 20693 10:02:00.912091 tst mo_mt_call_osmux.py: using BVCI 20694 10:02:01.030936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:02:01.042644 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:02:01.054116 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:02:01.066174 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:02:01.078419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:02:01.090613 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:02:01.238952 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:02:01.387206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:01.909829 run create_hlr_db(pid=23556): Launched 10:02:02.065494 bus /sierra_2: Setting Powered False 10:02:03.126710 run create_hlr_db(pid=23556): Terminated: ok {rc=0} 10:02:03.575783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23558): Launched 10:02:03.907348 run osmo-hlr_10.42.42.2(pid=23559): Launched 10:02:04.034867 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:04.604904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23561): Launched 10:02:04.933660 run osmo-stp_10.42.42.5(pid=23562): Launched 10:02:05.060391 run osmo-msc_10.42.42.6: Starting osmo-msc 10:02:05.657574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23564): Launched 10:02:05.991499 run osmo-msc_10.42.42.6(pid=23565): Launched 10:02:06.175606 run osmo-stp_10.42.42.5(pid=23562): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23562)] 10:02:06.315148 run osmo-stp_10.42.42.5(pid=23562): stdout: | (launched: 2022-12-09_10:02:04.873425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:06.455084 run osmo-stp_10.42.42.5(pid=23562): stderr: | 20221209100205067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100205068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100205068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100205068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100205069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100205069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100205069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:06.587822 run osmo-stp_10.42.42.5(pid=23562): stdout: | (launched: 2022-12-09_10:02:04.873425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:06.712143 run osmo-stp_10.42.42.5(pid=23562): stderr: | 20221209100205067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100205068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100205068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100205068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100205069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100205069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100205069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:06.859093 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23562): Process ended prematurely: osmo-stp_10.42.42.5(pid=23562) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23562)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:02:06.868014 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:02:06.895258 run osmo-hlr_10.42.42.2(pid=23559): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23559)] 10:02:06.943992 run osmo-hlr_10.42.42.2(pid=23559): stdout: | (launched: 2022-12-09_10:02:03.846923) 10:02:06.994619 run osmo-hlr_10.42.42.2(pid=23559): stderr: | 20221209100204046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100204046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100204046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100204046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100204046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100204046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100204059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100204067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100204067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100204067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:07.065104 run osmo-msc_10.42.42.6(pid=23565): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23565)] 10:02:07.113829 run osmo-msc_10.42.42.6(pid=23565): stdout: | (launched: 2022-12-09_10:02:05.930342) 10:02:07.164135 run osmo-msc_10.42.42.6(pid=23565): stderr: | 20221209100206254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100206254 DLGLOBAL DEBUG validating counter group 0x7f9f834a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100206254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100206254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100206254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100206255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100206257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100206257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100206257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100206257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:02:07.214915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23558): Terminating (SIGTERM) 10:02:07.254772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23561): Terminating (SIGTERM) 10:02:07.294820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23564): Terminating (SIGTERM) 10:02:07.335376 --- ParallelTerminationStrategy: PID 23558 died... 10:02:07.354795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23558): Terminated: ok {rc=0} 10:02:07.399726 --- ParallelTerminationStrategy: PID 23561 died... 10:02:07.418747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23561): Terminated: ok {rc=0} 10:02:07.463442 --- ParallelTerminationStrategy: PID 23564 died... 10:02:07.482557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23564): Terminated: ok {rc=0} 10:02:07.570068 bus /sierra_3: Setting Powered False 10:02:08.671536 bus /sierra_3: Setting Powered False 10:02:09.788568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:02:11.025443 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:11.032250 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:02:11.053253 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:02:11.079571 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:02:11.131706 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:02:11.152019 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:02:11.178113 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:02:11.731730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:02:11.782318 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:11.793364 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:02:11.847863 tst mo_mt_call.py: using LAC 20694 10:02:11.966745 tst mo_mt_call.py: using RAC 39 10:02:12.090824 tst mo_mt_call.py: using CellId 20694 10:02:12.210924 tst mo_mt_call.py: using BVCI 20695 10:02:12.323412 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:12.334722 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:12.345623 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:12.356320 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:12.367084 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:12.377907 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:02:12.495242 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:02:12.615216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:13.092406 run create_hlr_db(pid=23570): Launched 10:02:13.218170 bus /sierra_2: Setting Powered False 10:02:14.279451 run create_hlr_db(pid=23570): Terminated: ok {rc=0} 10:02:14.729555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23572): Launched 10:02:15.061452 run osmo-hlr_10.42.42.2(pid=23573): Launched 10:02:15.187791 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:15.755891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23575): Launched 10:02:16.117094 run osmo-stp_10.42.42.5(pid=23576): Launched 10:02:16.335534 run osmo-msc_10.42.42.6: Starting osmo-msc 10:02:17.154501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23578): Launched 10:02:17.480227 run osmo-msc_10.42.42.6(pid=23579): Launched 10:02:17.653666 run osmo-stp_10.42.42.5(pid=23576): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23576)] 10:02:17.784699 run osmo-stp_10.42.42.5(pid=23576): stdout: | (launched: 2022-12-09_10:02:16.058831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:17.915580 run osmo-stp_10.42.42.5(pid=23576): stderr: | 20221209100216395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100216395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100216395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100216396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100216396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100216396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100216396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:18.043130 run osmo-stp_10.42.42.5(pid=23576): stdout: | (launched: 2022-12-09_10:02:16.058831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:18.165375 run osmo-stp_10.42.42.5(pid=23576): stderr: | 20221209100216395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100216395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100216395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100216396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100216396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100216396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100216396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:18.311654 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23576): Process ended prematurely: osmo-stp_10.42.42.5(pid=23576) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23576)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:02:18.320795 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:02:18.347688 run osmo-hlr_10.42.42.2(pid=23573): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23573)] 10:02:18.395853 run osmo-hlr_10.42.42.2(pid=23573): stdout: | (launched: 2022-12-09_10:02:15.000631) 10:02:18.445700 run osmo-hlr_10.42.42.2(pid=23573): stderr: | 20221209100215200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100215201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100215201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100215201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100215201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100215201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100215227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100215237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100215237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100215238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:18.515133 run osmo-msc_10.42.42.6(pid=23579): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23579)] 10:02:18.563252 run osmo-msc_10.42.42.6(pid=23579): stdout: | (launched: 2022-12-09_10:02:17.423421) 10:02:18.613070 run osmo-msc_10.42.42.6(pid=23579): stderr: | 20221209100217698 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100217699 DLGLOBAL DEBUG validating counter group 0x7f1fb0819c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100217699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100217699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100217699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100217699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100217701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100217701 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100217701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100217702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:02:18.663088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23572): Terminating (SIGTERM) 10:02:18.702965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23575): Terminating (SIGTERM) 10:02:18.742649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23578): Terminating (SIGTERM) 10:02:18.782756 --- ParallelTerminationStrategy: PID 23572 died... 10:02:18.801999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23572): Terminated: ok {rc=0} 10:02:18.846305 --- ParallelTerminationStrategy: PID 23575 died... 10:02:18.865232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23575): Terminated: ok {rc=0} 10:02:18.909453 --- ParallelTerminationStrategy: PID 23578 died... 10:02:18.928214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23578): Terminated: ok {rc=0} 10:02:19.012171 bus /sierra_3: Setting Powered False 10:02:20.111045 bus /sierra_3: Setting Powered False 10:02:21.229906 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:02:22.377540 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:22.389297 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:02:22.445734 tst mo_mt_call_osmux.py: using LAC 20695 10:02:22.566369 tst mo_mt_call_osmux.py: using RAC 40 10:02:22.688276 tst mo_mt_call_osmux.py: using CellId 20695 10:02:22.809838 tst mo_mt_call_osmux.py: using BVCI 20696 10:02:22.920807 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:22.931920 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:22.942708 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:22.953607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:22.964401 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:02:22.975312 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:02:23.094220 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:02:23.211473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:23.689830 run create_hlr_db(pid=23581): Launched 10:02:23.817226 bus /sierra_2: Setting Powered False 10:02:24.878718 run create_hlr_db(pid=23581): Terminated: ok {rc=0} 10:02:25.305944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Launched 10:02:25.612431 run osmo-hlr_10.42.42.2(pid=23584): Launched 10:02:25.728841 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:26.258008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23586): Launched 10:02:26.564209 run osmo-stp_10.42.42.5(pid=23587): Launched 10:02:26.681537 run osmo-msc_10.42.42.6: Starting osmo-msc 10:02:27.235976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23589): Launched 10:02:27.542193 run osmo-msc_10.42.42.6(pid=23590): Launched 10:02:27.713634 run osmo-stp_10.42.42.5(pid=23587): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23587)] 10:02:27.842585 run osmo-stp_10.42.42.5(pid=23587): stdout: | (launched: 2022-12-09_10:02:26.507427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:27.972105 run osmo-stp_10.42.42.5(pid=23587): stderr: | 20221209100226679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100226679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100226679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100226680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100226680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100226680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100226680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:28.099871 run osmo-stp_10.42.42.5(pid=23587): stdout: | (launched: 2022-12-09_10:02:26.507427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:28.221816 run osmo-stp_10.42.42.5(pid=23587): stderr: | 20221209100226679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100226679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100226679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100226680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100226680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100226680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100226680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:28.367291 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23587): Process ended prematurely: osmo-stp_10.42.42.5(pid=23587) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23587)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:02:28.376619 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:02:28.403386 run osmo-hlr_10.42.42.2(pid=23584): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23584)] 10:02:28.451386 run osmo-hlr_10.42.42.2(pid=23584): stdout: | (launched: 2022-12-09_10:02:25.555852) 10:02:28.501232 run osmo-hlr_10.42.42.2(pid=23584): stderr: | 20221209100225730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100225730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100225730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100225731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100225731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100225731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100225759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100225769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100225769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100225769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:28.570560 run osmo-msc_10.42.42.6(pid=23590): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23590)] 10:02:28.618223 run osmo-msc_10.42.42.6(pid=23590): stdout: | (launched: 2022-12-09_10:02:27.485573) 10:02:28.667607 run osmo-msc_10.42.42.6(pid=23590): stderr: | 20221209100227759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100227759 DLGLOBAL DEBUG validating counter group 0x7f6dcc6e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100227759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100227760 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100227760 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100227760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100227762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100227762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100227762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100227762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:02:28.717316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Terminating (SIGTERM) 10:02:28.757045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23586): Terminating (SIGTERM) 10:02:28.796445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23589): Terminating (SIGTERM) 10:02:28.836443 --- ParallelTerminationStrategy: PID 23583 died... 10:02:28.855650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Terminated: ok {rc=0} 10:02:28.899766 --- ParallelTerminationStrategy: PID 23586 died... 10:02:28.918420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23586): Terminated: ok {rc=0} 10:02:28.962437 --- ParallelTerminationStrategy: PID 23589 died... 10:02:28.981203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23589): Terminated: ok {rc=0} 10:02:29.067046 bus /sierra_3: Setting Powered False 10:02:30.167169 bus /sierra_3: Setting Powered False 10:02:31.286724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:02:32.525799 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:32.532810 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:02:32.553532 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:02:32.580354 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:02:32.631926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:02:32.651919 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:02:32.678039 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:02:33.230664 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:02:33.285496 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:33.297229 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:02:33.355802 tst mo_mt_call.py: using LAC 20696 10:02:33.485592 tst mo_mt_call.py: using RAC 41 10:02:33.616615 tst mo_mt_call.py: using CellId 20696 10:02:33.748258 tst mo_mt_call.py: using BVCI 20697 10:02:33.868264 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:33.879781 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:33.891033 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:33.902589 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:33.914054 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:33.925573 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:02:34.047610 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:02:34.165444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:34.644914 run create_hlr_db(pid=23595): Launched 10:02:34.772889 bus /sierra_2: Setting Powered False 10:02:35.835292 run create_hlr_db(pid=23595): Terminated: ok {rc=0} 10:02:36.284869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23600): Launched 10:02:36.617647 run osmo-hlr_10.42.42.2(pid=23601): Launched 10:02:36.745744 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:37.314849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23603): Launched 10:02:37.644659 run osmo-stp_10.42.42.5(pid=23604): Launched 10:02:37.772197 run osmo-msc_10.42.42.6: Starting osmo-msc 10:02:38.370703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23606): Launched 10:02:38.702872 run osmo-msc_10.42.42.6(pid=23607): Launched 10:02:38.888286 run osmo-stp_10.42.42.5(pid=23604): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23604)] 10:02:39.027561 run osmo-stp_10.42.42.5(pid=23604): stdout: | (launched: 2022-12-09_10:02:37.584234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:39.167621 run osmo-stp_10.42.42.5(pid=23604): stderr: | 20221209100237777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100237777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100237777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100237778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100237778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100237778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100237778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:39.305480 run osmo-stp_10.42.42.5(pid=23604): stdout: | (launched: 2022-12-09_10:02:37.584234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:39.437173 run osmo-stp_10.42.42.5(pid=23604): stderr: | 20221209100237777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100237777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100237777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100237778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100237778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100237778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100237778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:39.594626 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23604): Process ended prematurely: osmo-stp_10.42.42.5(pid=23604) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23604)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:02:39.604562 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:02:39.633614 run osmo-hlr_10.42.42.2(pid=23601): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23601)] 10:02:39.684673 run osmo-hlr_10.42.42.2(pid=23601): stdout: | (launched: 2022-12-09_10:02:36.557135) 10:02:39.737316 run osmo-hlr_10.42.42.2(pid=23601): stderr: | 20221209100236757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100236757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100236757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100236757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100236757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100236757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100236770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100236779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100236779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100236779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:39.810201 run osmo-msc_10.42.42.6(pid=23607): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23607)] 10:02:39.861212 run osmo-msc_10.42.42.6(pid=23607): stdout: | (launched: 2022-12-09_10:02:38.642319) 10:02:39.913768 run osmo-msc_10.42.42.6(pid=23607): stderr: | 20221209100238963 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100238963 DLGLOBAL DEBUG validating counter group 0x7f552336dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100238963 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100238963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100238963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100238964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100238965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100238966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100238966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100238966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:02:39.966783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23600): Terminating (SIGTERM) 10:02:40.009133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23603): Terminating (SIGTERM) 10:02:40.051954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23606): Terminating (SIGTERM) 10:02:40.095193 --- ParallelTerminationStrategy: PID 23600 died... 10:02:40.115284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23600): Terminated: ok {rc=0} 10:02:40.162982 --- ParallelTerminationStrategy: PID 23603 died... 10:02:40.183103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23603): Terminated: ok {rc=0} 10:02:40.230267 --- ParallelTerminationStrategy: PID 23606 died... 10:02:40.250121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23606): Terminated: ok {rc=0} 10:02:40.339172 bus /sierra_3: Setting Powered False 10:02:41.439374 bus /sierra_3: Setting Powered False 10:02:42.556387 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:02:43.700267 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:43.711868 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:02:43.766196 tst mo_mt_call_osmux.py: using LAC 20697 10:02:43.885086 tst mo_mt_call_osmux.py: using RAC 42 10:02:44.007354 tst mo_mt_call_osmux.py: using CellId 20697 10:02:44.127868 tst mo_mt_call_osmux.py: using BVCI 20698 10:02:44.239075 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:44.250108 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:44.260755 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:44.271483 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:44.282228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:02:44.293046 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:02:44.412483 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:02:44.534014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:45.048167 run create_hlr_db(pid=23609): Launched 10:02:45.176026 bus /sierra_2: Setting Powered False 10:02:46.255807 run create_hlr_db(pid=23609): Terminated: ok {rc=0} 10:02:46.738042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23611): Launched 10:02:47.089683 run osmo-hlr_10.42.42.2(pid=23612): Launched 10:02:47.284628 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:47.813688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23614): Launched 10:02:48.123191 run osmo-stp_10.42.42.5(pid=23615): Launched 10:02:48.239981 run osmo-msc_10.42.42.6: Starting osmo-msc 10:02:48.797149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23617): Launched 10:02:49.104202 run osmo-msc_10.42.42.6(pid=23618): Launched 10:02:49.276660 run osmo-stp_10.42.42.5(pid=23615): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23615)] 10:02:49.407070 run osmo-stp_10.42.42.5(pid=23615): stdout: | (launched: 2022-12-09_10:02:48.065589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:49.536716 run osmo-stp_10.42.42.5(pid=23615): stderr: | 20221209100248238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100248238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100248239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100248239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100248239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100248240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100248240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:49.664455 run osmo-stp_10.42.42.5(pid=23615): stdout: | (launched: 2022-12-09_10:02:48.065589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:49.786903 run osmo-stp_10.42.42.5(pid=23615): stderr: | 20221209100248238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100248238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100248239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100248239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100248239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100248240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100248240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:49.933216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23615): Process ended prematurely: osmo-stp_10.42.42.5(pid=23615) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23615)] [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:02:49.942146 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:02:49.969160 run osmo-hlr_10.42.42.2(pid=23612): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23612)] 10:02:50.017736 run osmo-hlr_10.42.42.2(pid=23612): stdout: | (launched: 2022-12-09_10:02:47.022697) 10:02:50.068364 run osmo-hlr_10.42.42.2(pid=23612): stderr: | 20221209100247236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100247236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100247236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100247236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100247236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100247236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100247248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100247256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100247256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100247256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:50.139076 run osmo-msc_10.42.42.6(pid=23618): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23618)] 10:02:50.187932 run osmo-msc_10.42.42.6(pid=23618): stdout: | (launched: 2022-12-09_10:02:49.047352) 10:02:50.238350 run osmo-msc_10.42.42.6(pid=23618): stderr: | 20221209100249318 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100249318 DLGLOBAL DEBUG validating counter group 0x7f3aedb95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100249318 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100249318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100249319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100249319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100249321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100249321 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100249321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100249321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:02:50.289071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23611): Terminating (SIGTERM) 10:02:50.329494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23614): Terminating (SIGTERM) 10:02:50.369613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23617): Terminating (SIGTERM) 10:02:50.410200 --- ParallelTerminationStrategy: PID 23611 died... 10:02:50.429504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23611): Terminated: ok {rc=0} 10:02:50.474095 --- ParallelTerminationStrategy: PID 23614 died... 10:02:50.492718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23614): Terminated: ok {rc=0} 10:02:50.537999 --- ParallelTerminationStrategy: PID 23617 died... 10:02:50.556752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23617): Terminated: ok {rc=0} 10:02:50.643342 bus /sierra_3: Setting Powered False 10:02:51.744313 bus /sierra_3: Setting Powered False 10:02:52.861912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:02:54.098921 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:54.105392 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:02:54.125795 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:02:54.151953 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:02:54.204475 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:02:54.225187 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:02:54.251231 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:02:54.800335 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:02:54.849605 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:02:54.860479 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:02:54.915792 tst mo_mt_call.py: using LAC 20698 10:02:55.036781 tst mo_mt_call.py: using RAC 43 10:02:55.158147 tst mo_mt_call.py: using CellId 20698 10:02:55.277558 tst mo_mt_call.py: using BVCI 20699 10:02:55.387971 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:02:55.399017 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:02:55.409932 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:02:55.420690 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:02:55.431511 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:02:55.442448 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:02:55.560025 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:02:55.675798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:56.155161 run create_hlr_db(pid=23623): Launched 10:02:56.280834 bus /sierra_2: Setting Powered False 10:02:57.342219 run create_hlr_db(pid=23623): Terminated: ok {rc=0} 10:02:57.770196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23625): Launched 10:02:58.078193 run osmo-hlr_10.42.42.2(pid=23626): Launched 10:02:58.195269 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:58.737307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23628): Launched 10:02:59.043745 run osmo-stp_10.42.42.5(pid=23629): Launched 10:02:59.160340 run osmo-msc_10.42.42.6: Starting osmo-msc 10:02:59.713685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23631): Launched 10:03:00.022039 run osmo-msc_10.42.42.6(pid=23632): Launched 10:03:00.192688 run osmo-stp_10.42.42.5(pid=23629): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23629)] 10:03:00.322484 run osmo-stp_10.42.42.5(pid=23629): stdout: | (launched: 2022-12-09_10:02:58.986999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:00.451908 run osmo-stp_10.42.42.5(pid=23629): stderr: | 20221209100259160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100259160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100259160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100259161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100259161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100259161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100259161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:00.579263 run osmo-stp_10.42.42.5(pid=23629): stdout: | (launched: 2022-12-09_10:02:58.986999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:00.701961 run osmo-stp_10.42.42.5(pid=23629): stderr: | 20221209100259160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100259160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100259160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100259161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100259161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100259161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100259161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:00.858590 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23629): Process ended prematurely: osmo-stp_10.42.42.5(pid=23629) [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23629)] [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:03:00.869491 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:03:00.908379 run osmo-hlr_10.42.42.2(pid=23626): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23626)] 10:03:00.967204 run osmo-hlr_10.42.42.2(pid=23626): stdout: | (launched: 2022-12-09_10:02:58.021697) 10:03:01.023410 run osmo-hlr_10.42.42.2(pid=23626): stderr: | 20221209100258198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100258198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100258198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100258198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100258198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100258198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100258210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100258218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100258218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100258218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:01.102493 run osmo-msc_10.42.42.6(pid=23632): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23632)] 10:03:01.156691 run osmo-msc_10.42.42.6(pid=23632): stdout: | (launched: 2022-12-09_10:02:59.964536) 10:03:01.213621 run osmo-msc_10.42.42.6(pid=23632): stderr: | 20221209100300238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100300238 DLGLOBAL DEBUG validating counter group 0x7f7a6bbc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100300238 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100300239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100300239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100300239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100300241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100300241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100300241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100300241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:01.269784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23625): Terminating (SIGTERM) 10:03:01.315595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23628): Terminating (SIGTERM) 10:03:01.363089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23631): Terminating (SIGTERM) 10:03:01.411661 --- ParallelTerminationStrategy: PID 23625 died... 10:03:01.433012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23625): Terminated: ok {rc=0} 10:03:01.485354 --- ParallelTerminationStrategy: PID 23628 died... 10:03:01.506382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23628): Terminated: ok {rc=0} 10:03:01.556282 --- ParallelTerminationStrategy: PID 23631 died... 10:03:01.580580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23631): Terminated: ok {rc=0} 10:03:01.674847 bus /sierra_3: Setting Powered False 10:03:02.777462 bus /sierra_3: Setting Powered False 10:03:03.897054 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:03:05.049058 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:03:05.061760 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:03:05.121251 tst mo_mt_call_osmux.py: using LAC 20699 10:03:05.252914 tst mo_mt_call_osmux.py: using RAC 44 10:03:05.382838 tst mo_mt_call_osmux.py: using CellId 20699 10:03:05.515002 tst mo_mt_call_osmux.py: using BVCI 20700 10:03:05.635988 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:03:05.647611 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:03:05.658928 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:03:05.670973 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:03:05.683189 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:03:05.695293 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:03:05.815055 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:03:05.936695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:06.452446 run create_hlr_db(pid=23635): Launched 10:03:06.578073 bus /sierra_2: Setting Powered False 10:03:07.643200 run create_hlr_db(pid=23635): Terminated: ok {rc=0} 10:03:08.101913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23637): Launched 10:03:08.434532 run osmo-hlr_10.42.42.2(pid=23638): Launched 10:03:08.562866 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:09.134005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23640): Launched 10:03:09.465240 run osmo-stp_10.42.42.5(pid=23641): Launched 10:03:09.593978 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:10.193859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23643): Launched 10:03:10.525727 run osmo-msc_10.42.42.6(pid=23644): Launched 10:03:10.710558 run osmo-stp_10.42.42.5(pid=23641): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23641)] 10:03:10.849735 run osmo-stp_10.42.42.5(pid=23641): stdout: | (launched: 2022-12-09_10:03:09.404398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:10.989235 run osmo-stp_10.42.42.5(pid=23641): stderr: | 20221209100309599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100309599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100309599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100309599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100309600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100309600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100309600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:11.127777 run osmo-stp_10.42.42.5(pid=23641): stdout: | (launched: 2022-12-09_10:03:09.404398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:11.260080 run osmo-stp_10.42.42.5(pid=23641): stderr: | 20221209100309599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100309599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100309599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100309599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100309600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100309600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100309600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:11.417345 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23641): Process ended prematurely: osmo-stp_10.42.42.5(pid=23641) [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23641)] [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:03:11.427055 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:03:11.455823 run osmo-hlr_10.42.42.2(pid=23638): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23638)] 10:03:11.506719 run osmo-hlr_10.42.42.2(pid=23638): stdout: | (launched: 2022-12-09_10:03:08.374169) 10:03:11.559784 run osmo-hlr_10.42.42.2(pid=23638): stderr: | 20221209100308573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100308573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100308573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100308573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100308573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100308573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100308585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100308593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100308594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100308594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:11.633633 run osmo-msc_10.42.42.6(pid=23644): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23644)] 10:03:11.684788 run osmo-msc_10.42.42.6(pid=23644): stdout: | (launched: 2022-12-09_10:03:10.464290) 10:03:11.737646 run osmo-msc_10.42.42.6(pid=23644): stderr: | 20221209100310791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100310792 DLGLOBAL DEBUG validating counter group 0x7f84ba4cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100310792 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100310792 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100310792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100310792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100310794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100310794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100310794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100310795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:11.790576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23637): Terminating (SIGTERM) 10:03:11.833305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23640): Terminating (SIGTERM) 10:03:11.875928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23643): Terminating (SIGTERM) 10:03:11.919008 --- ParallelTerminationStrategy: PID 23637 died... 10:03:11.939451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23637): Terminated: ok {rc=0} 10:03:11.987204 --- ParallelTerminationStrategy: PID 23640 died... 10:03:12.007150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23640): Terminated: ok {rc=0} 10:03:12.054353 --- ParallelTerminationStrategy: PID 23643 died... 10:03:12.074281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23643): Terminated: ok {rc=0} 10:03:12.162572 bus /sierra_3: Setting Powered False 10:03:13.262418 bus /sierra_3: Setting Powered False 10:03:14.381416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:03:15.614620 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:15.620308 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:03:15.641040 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:03:15.667531 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:03:15.718972 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:03:15.739421 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:03:15.765756 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:03:16.355261 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:03:16.417549 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:16.429913 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:03:16.490425 tst mo_mt_call.py: using LAC 20700 10:03:16.627643 tst mo_mt_call.py: using RAC 45 10:03:16.779165 tst mo_mt_call.py: using CellId 20700 10:03:16.902543 tst mo_mt_call.py: using BVCI 20701 10:03:17.056139 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:17.068037 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:17.081149 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:17.092345 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:17.103878 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:17.115542 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:03:17.231174 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:03:17.353161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:17.867420 run create_hlr_db(pid=23649): Launched 10:03:17.994665 bus /sierra_2: Setting Powered False 10:03:19.059614 run create_hlr_db(pid=23649): Terminated: ok {rc=0} 10:03:19.518986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Launched 10:03:19.850336 run osmo-hlr_10.42.42.2(pid=23652): Launched 10:03:19.977753 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:20.548449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Launched 10:03:20.879561 run osmo-stp_10.42.42.5(pid=23655): Launched 10:03:21.008119 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:21.607385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23657): Launched 10:03:21.938809 run osmo-msc_10.42.42.6(pid=23658): Launched 10:03:22.124172 run osmo-stp_10.42.42.5(pid=23655): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] 10:03:22.263615 run osmo-stp_10.42.42.5(pid=23655): stdout: | (launched: 2022-12-09_10:03:20.819184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:22.402829 run osmo-stp_10.42.42.5(pid=23655): stderr: | 20221209100321011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100321011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100321011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100321011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100321012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100321012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100321012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:22.541184 run osmo-stp_10.42.42.5(pid=23655): stdout: | (launched: 2022-12-09_10:03:20.819184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:22.672719 run osmo-stp_10.42.42.5(pid=23655): stderr: | 20221209100321011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100321011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100321011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100321011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100321012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100321012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100321012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:22.829961 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23655): Process ended prematurely: osmo-stp_10.42.42.5(pid=23655) [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:03:22.839732 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:03:22.868668 run osmo-hlr_10.42.42.2(pid=23652): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23652)] 10:03:22.919932 run osmo-hlr_10.42.42.2(pid=23652): stdout: | (launched: 2022-12-09_10:03:19.789797) 10:03:22.972884 run osmo-hlr_10.42.42.2(pid=23652): stderr: | 20221209100319988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100319989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100319989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100319989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100319989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100319989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100320001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100320010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100320011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100320011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:23.046778 run osmo-msc_10.42.42.6(pid=23658): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23658)] 10:03:23.098208 run osmo-msc_10.42.42.6(pid=23658): stdout: | (launched: 2022-12-09_10:03:21.878051) 10:03:23.151540 run osmo-msc_10.42.42.6(pid=23658): stderr: | 20221209100322201 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100322201 DLGLOBAL DEBUG validating counter group 0x7f64b4f41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100322201 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100322201 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100322201 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100322202 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100322203 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100322204 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100322204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100322204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:23.204666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Terminating (SIGTERM) 10:03:23.247305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Terminating (SIGTERM) 10:03:23.290017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23657): Terminating (SIGTERM) 10:03:23.332930 --- ParallelTerminationStrategy: PID 23651 died... 10:03:23.353447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Terminated: ok {rc=0} 10:03:23.400739 --- ParallelTerminationStrategy: PID 23654 died... 10:03:23.420740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Terminated: ok {rc=0} 10:03:23.468019 --- ParallelTerminationStrategy: PID 23657 died... 10:03:23.487873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23657): Terminated: ok {rc=0} 10:03:23.576748 bus /sierra_3: Setting Powered False 10:03:24.678306 bus /sierra_3: Setting Powered False 10:03:25.797206 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:03:26.949751 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:26.961719 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:03:27.020315 tst mo_mt_call_osmux.py: using LAC 20701 10:03:27.151320 tst mo_mt_call_osmux.py: using RAC 46 10:03:27.283054 tst mo_mt_call_osmux.py: using CellId 20701 10:03:27.413052 tst mo_mt_call_osmux.py: using BVCI 20702 10:03:27.526325 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:27.537577 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:27.548334 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:27.559831 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:27.571269 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:03:27.582809 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:03:27.704224 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:03:27.820509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:28.333784 run create_hlr_db(pid=23660): Launched 10:03:28.459784 bus /sierra_2: Setting Powered False 10:03:29.525809 run create_hlr_db(pid=23660): Terminated: ok {rc=0} 10:03:29.966861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23662): Launched 10:03:30.274226 run osmo-hlr_10.42.42.2(pid=23663): Launched 10:03:30.391807 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:30.957779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23665): Launched 10:03:31.304899 run osmo-stp_10.42.42.5(pid=23666): Launched 10:03:31.653821 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:32.335188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23668): Launched 10:03:32.646402 run osmo-msc_10.42.42.6(pid=23669): Launched 10:03:32.819460 run osmo-stp_10.42.42.5(pid=23666): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23666)] 10:03:32.948197 run osmo-stp_10.42.42.5(pid=23666): stdout: | (launched: 2022-12-09_10:03:31.242778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:33.077240 run osmo-stp_10.42.42.5(pid=23666): stderr: | 20221209100331522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100331522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100331522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100331523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100331525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100331525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100331525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:33.204810 run osmo-stp_10.42.42.5(pid=23666): stdout: | (launched: 2022-12-09_10:03:31.242778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:33.327434 run osmo-stp_10.42.42.5(pid=23666): stderr: | 20221209100331522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100331522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100331522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100331523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100331525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100331525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100331525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:33.473948 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23666): Process ended prematurely: osmo-stp_10.42.42.5(pid=23666) [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23666)] [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:03:33.483107 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:03:33.510050 run osmo-hlr_10.42.42.2(pid=23663): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23663)] 10:03:33.558253 run osmo-hlr_10.42.42.2(pid=23663): stdout: | (launched: 2022-12-09_10:03:30.217598) 10:03:33.608186 run osmo-hlr_10.42.42.2(pid=23663): stderr: | 20221209100330394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100330394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100330394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100330394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100330394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100330394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100330406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100330417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100330417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100330417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:33.677859 run osmo-msc_10.42.42.6(pid=23669): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23669)] 10:03:33.726014 run osmo-msc_10.42.42.6(pid=23669): stdout: | (launched: 2022-12-09_10:03:32.589577) 10:03:33.775817 run osmo-msc_10.42.42.6(pid=23669): stderr: | 20221209100332862 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100332862 DLGLOBAL DEBUG validating counter group 0x7f519532ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100332862 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100332862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100332863 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100332863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100332864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100332865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100332865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100332865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:33.825920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23662): Terminating (SIGTERM) 10:03:33.865796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23665): Terminating (SIGTERM) 10:03:33.905695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23668): Terminating (SIGTERM) 10:03:33.945836 --- ParallelTerminationStrategy: PID 23662 died... 10:03:33.964836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23662): Terminated: ok {rc=0} 10:03:34.009754 --- ParallelTerminationStrategy: PID 23665 died... 10:03:34.028626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23665): Terminated: ok {rc=0} 10:03:34.072646 --- ParallelTerminationStrategy: PID 23668 died... 10:03:34.091560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23668): Terminated: ok {rc=0} 10:03:34.176365 bus /sierra_3: Setting Powered False 10:03:35.271975 bus /sierra_3: Setting Powered False 10:03:36.385809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:oc2g --------------------------------------------------------------------- 10:03:37.622270 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:37.626841 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 10:03:37.648287 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 10:03:37.675560 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 10:03:37.761238 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 10:03:37.782377 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 10:03:37.810053 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 10:03:38.392930 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 10:03:38.398150 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:38.409188 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:03:38.446315 tst emergency_mo_mt_call.py: using LAC 20702 10:03:38.575777 tst emergency_mo_mt_call.py: using RAC 47 10:03:38.702941 tst emergency_mo_mt_call.py: using CellId 20702 10:03:38.832545 tst emergency_mo_mt_call.py: using BVCI 20703 10:03:38.952582 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:38.963667 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:38.974589 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:38.985761 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:38.996838 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:39.007964 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:03:39.123802 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:03:39.241894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:39.745511 run create_hlr_db(pid=23674): Launched 10:03:39.870806 bus /sierra_2: Setting Powered False 10:03:40.934647 run create_hlr_db(pid=23674): Terminated: ok {rc=0} 10:03:41.387040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23676): Launched 10:03:41.712727 run osmo-hlr_10.42.42.2(pid=23677): Launched 10:03:41.836792 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:42.395041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23679): Launched 10:03:42.720502 run osmo-stp_10.42.42.5(pid=23680): Launched 10:03:42.854416 tst emergency_mo_mt_call.py: using MSISDN 7154 10:03:43.025793 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:43.611280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23682): Launched 10:03:43.936268 run osmo-msc_10.42.42.6(pid=23683): Launched 10:03:44.118537 run osmo-stp_10.42.42.5(pid=23680): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23680)] 10:03:44.255180 run osmo-stp_10.42.42.5(pid=23680): stdout: | (launched: 2022-12-09_10:03:42.660681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:44.391664 run osmo-stp_10.42.42.5(pid=23680): stderr: | 20221209100342853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100342854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100342854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100342854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100342855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100342855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100342855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:44.527835 run osmo-stp_10.42.42.5(pid=23680): stdout: | (launched: 2022-12-09_10:03:42.660681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:44.657117 run osmo-stp_10.42.42.5(pid=23680): stderr: | 20221209100342853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100342854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100342854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100342854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100342855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100342855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100342855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:44.811383 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23680): Process ended prematurely: osmo-stp_10.42.42.5(pid=23680) [trial-2358↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23680)] [trial-2358↪emergency:oc2g↪emergency_mo_mt_call.py:19] 10:03:44.820406 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 10:03:44.848920 run osmo-hlr_10.42.42.2(pid=23677): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23677)] 10:03:44.900155 run osmo-hlr_10.42.42.2(pid=23677): stdout: | (launched: 2022-12-09_10:03:41.652422) 10:03:44.953275 run osmo-hlr_10.42.42.2(pid=23677): stderr: | 20221209100341852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100341852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100341852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100341852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100341852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100341852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100341865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100341873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100341873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100341873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:45.026877 run osmo-msc_10.42.42.6(pid=23683): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23683)] 10:03:45.078276 run osmo-msc_10.42.42.6(pid=23683): stdout: | (launched: 2022-12-09_10:03:43.876075) 10:03:45.131290 run osmo-msc_10.42.42.6(pid=23683): stderr: | 20221209100344200 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100344200 DLGLOBAL DEBUG validating counter group 0x7f7962688c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100344200 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100344200 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100344201 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100344201 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100344203 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100344203 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100344203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100344203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:45.185190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23676): Terminating (SIGTERM) 10:03:45.227920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23679): Terminating (SIGTERM) 10:03:45.270912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23682): Terminating (SIGTERM) 10:03:45.313908 --- ParallelTerminationStrategy: PID 23676 died... 10:03:45.334229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23676): Terminated: ok {rc=0} 10:03:45.381674 --- ParallelTerminationStrategy: PID 23679 died... 10:03:45.401677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23679): Terminated: ok {rc=0} 10:03:45.449010 --- ParallelTerminationStrategy: PID 23682 died... 10:03:45.468744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23682): Terminated: ok {rc=0} 10:03:45.558499 bus /sierra_3: Setting Powered False 10:03:46.661399 bus /sierra_3: Setting Powered False 10:03:47.793750 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 10:03:48.882483 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:48.894277 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:03:48.933047 tst emergency_preemptive_call.py: using LAC 20703 10:03:49.061383 tst emergency_preemptive_call.py: using RAC 48 10:03:49.188243 tst emergency_preemptive_call.py: using CellId 20703 10:03:49.317744 tst emergency_preemptive_call.py: using BVCI 20704 10:03:49.437366 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:49.448285 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:49.459170 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:49.470334 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:49.481517 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:03:49.492501 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:03:49.611909 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:03:49.728529 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:03:49.848156 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:03:49.963890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:50.436830 run create_hlr_db(pid=23686): Launched 10:03:50.562195 bus /sierra_2: Setting Powered False 10:03:51.622749 run create_hlr_db(pid=23686): Terminated: ok {rc=0} 10:03:52.044836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23688): Launched 10:03:52.347401 run osmo-hlr_10.42.42.2(pid=23689): Launched 10:03:52.462437 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:52.995496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23691): Launched 10:03:53.296866 run osmo-stp_10.42.42.5(pid=23692): Launched 10:03:53.423896 tst emergency_preemptive_call.py: using MSISDN 7155 10:03:53.576698 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:54.117759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23694): Launched 10:03:54.421373 run osmo-msc_10.42.42.6(pid=23695): Launched 10:03:54.589767 run osmo-stp_10.42.42.5(pid=23692): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23692)] 10:03:54.717330 run osmo-stp_10.42.42.5(pid=23692): stdout: | (launched: 2022-12-09_10:03:53.240707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:54.844484 run osmo-stp_10.42.42.5(pid=23692): stderr: | 20221209100353412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100353412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100353412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100353412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100353413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100353413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100353413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:54.970102 run osmo-stp_10.42.42.5(pid=23692): stdout: | (launched: 2022-12-09_10:03:53.240707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:55.090345 run osmo-stp_10.42.42.5(pid=23692): stderr: | 20221209100353412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100353412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100353412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100353412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100353413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100353413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100353413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:55.233790 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23692): Process ended prematurely: osmo-stp_10.42.42.5(pid=23692) [trial-2358↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23692)] [trial-2358↪emergency:oc2g↪emergency_preemptive_call.py:32] 10:03:55.242388 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 10:03:55.269130 run osmo-hlr_10.42.42.2(pid=23689): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23689)] 10:03:55.317476 run osmo-hlr_10.42.42.2(pid=23689): stdout: | (launched: 2022-12-09_10:03:52.291421) 10:03:55.367526 run osmo-hlr_10.42.42.2(pid=23689): stderr: | 20221209100352469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100352469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100352469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100352469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100352469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100352469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100352481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100352490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100352491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100352491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:55.437296 run osmo-msc_10.42.42.6(pid=23695): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23695)] 10:03:55.485430 run osmo-msc_10.42.42.6(pid=23695): stdout: | (launched: 2022-12-09_10:03:54.364618) 10:03:55.535243 run osmo-msc_10.42.42.6(pid=23695): stderr: | 20221209100354642 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100354642 DLGLOBAL DEBUG validating counter group 0x7f70e0482c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100354642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100354642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100354643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100354643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100354645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100354645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100354645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100354645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:55.585610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23688): Terminating (SIGTERM) 10:03:55.625753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23691): Terminating (SIGTERM) 10:03:55.665809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23694): Terminating (SIGTERM) 10:03:55.706286 --- ParallelTerminationStrategy: PID 23688 died... 10:03:55.725720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23688): Terminated: ok {rc=0} 10:03:55.770342 --- ParallelTerminationStrategy: PID 23691 died... 10:03:55.789349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23691): Terminated: ok {rc=0} 10:03:55.833690 --- ParallelTerminationStrategy: PID 23694 died... 10:03:55.852755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23694): Terminated: ok {rc=0} 10:03:55.939409 bus /sierra_9: Setting Powered False 10:03:57.040529 bus /sierra_9: Setting Powered False 10:03:58.159000 bus /sierra_8: Setting Powered False 10:03:59.259786 bus /sierra_8: Setting Powered False 10:04:00.376459 bus /sierra_3: Setting Powered False 10:04:01.473667 bus /sierra_3: Setting Powered False 10:04:02.592847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:oc2g --------------------------------------------------------------------- 10:04:03.850388 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:04:03.854572 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 10:04:03.874804 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 10:04:03.912644 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 10:04:03.998683 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 10:04:04.019051 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 10:04:04.056997 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 10:04:04.644146 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 10:04:04.694366 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:04.704831 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:04:04.740123 tst cs_paging_gprs_active.py: using LAC 20704 10:04:04.863828 tst cs_paging_gprs_active.py: using RAC 49 10:04:04.986507 tst cs_paging_gprs_active.py: using CellId 20704 10:04:05.109140 tst cs_paging_gprs_active.py: using BVCI 20705 10:04:05.222423 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.232999 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.243360 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.254012 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.264315 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.274729 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.285276 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.295986 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:05.306574 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:05.427083 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:05.543785 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:04:05.749365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:06.058604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23700): Launched 10:04:06.327736 run iperf3-srv_10.42.42.10(pid=23701): Launched 10:04:06.442823 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:04:06.647280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:06.955227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23702): Launched 10:04:07.224063 run iperf3-srv_10.42.42.10(pid=23703): Launched 10:04:07.339190 tst cs_paging_gprs_active.py:38: start network... 10:04:07.544138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:08.018928 run create_hlr_db(pid=23704): Launched 10:04:08.145652 bus /sierra_2: Setting Powered False 10:04:09.206705 run create_hlr_db(pid=23704): Terminated: ok {rc=0} 10:04:09.655885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23706): Launched 10:04:09.988607 run osmo-hlr_10.42.42.2(pid=23707): Launched 10:04:10.116441 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:10.686809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23709): Launched 10:04:11.018366 run osmo-stp_10.42.42.5(pid=23710): Launched 10:04:11.146519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:11.716453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23712): Launched 10:04:11.843958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:12.147532 run patchelf(pid=23713): Launched 10:04:12.332919 run osmo-stp_10.42.42.5(pid=23710): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23710)] 10:04:12.472319 run osmo-stp_10.42.42.5(pid=23710): stdout: | (launched: 2022-12-09_10:04:10.957652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:12.613330 run osmo-stp_10.42.42.5(pid=23710): stderr: | 20221209100411147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100411147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100411148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100411148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100411149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100411149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100411149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:12.754585 run osmo-stp_10.42.42.5(pid=23710): stdout: | (launched: 2022-12-09_10:04:10.957652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:12.890473 run osmo-stp_10.42.42.5(pid=23710): stderr: | 20221209100411147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100411147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100411148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100411148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100411149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100411149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100411149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:13.051413 run patchelf(pid=23713): Terminating (SIGINT) 10:04:13.237771 run patchelf(pid=23713): Terminated: ok {rc=0} 10:04:13.371454 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23710): Process ended prematurely: osmo-stp_10.42.42.5(pid=23710) [trial-2358↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23710)] [trial-2358↪gprs:oc2g↪cs_paging_gprs_active.py:38] 10:04:13.381738 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:04:13.411576 run osmo-hlr_10.42.42.2(pid=23707): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23707)] 10:04:13.463110 run osmo-hlr_10.42.42.2(pid=23707): stdout: | (launched: 2022-12-09_10:04:09.927891) 10:04:13.516315 run osmo-hlr_10.42.42.2(pid=23707): stderr: | 20221209100410129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100410129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100410129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100410129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100410129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100410129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100410141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100410150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100410150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100410150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:13.570096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23700): Terminating (SIGTERM) 10:04:13.612707 run iperf3-srv_10.42.42.10(pid=23701): Terminating (SIGTERM) 10:04:13.655078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23702): Terminating (SIGTERM) 10:04:13.697524 run iperf3-srv_10.42.42.10(pid=23703): Terminating (SIGTERM) 10:04:13.739670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23706): Terminating (SIGTERM) 10:04:13.782265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23709): Terminating (SIGTERM) 10:04:13.824630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23712): Terminating (SIGTERM) 10:04:13.867322 --- ParallelTerminationStrategy: PID 23700 died... 10:04:13.887616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23700): Terminated: ok {rc=0} 10:04:13.934574 --- ParallelTerminationStrategy: PID 23701 died... 10:04:13.954232 run iperf3-srv_10.42.42.10(pid=23701): Terminated {rc=256} 10:04:14.000795 --- ParallelTerminationStrategy: PID 23702 died... 10:04:14.020874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23702): Terminated: ok {rc=0} 10:04:14.067549 --- ParallelTerminationStrategy: PID 23703 died... 10:04:14.087206 run iperf3-srv_10.42.42.10(pid=23703): Terminated {rc=256} 10:04:14.134071 --- ParallelTerminationStrategy: PID 23706 died... 10:04:14.153885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23706): Terminated: ok {rc=0} 10:04:14.201172 --- ParallelTerminationStrategy: PID 23709 died... 10:04:14.220836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23709): Terminated: ok {rc=0} 10:04:14.267757 --- ParallelTerminationStrategy: PID 23712 died... 10:04:14.287469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23712): Terminated: ok {rc=0} 10:04:14.375969 bus /gobi_0: Setting Powered False 10:04:15.474738 bus /gobi_0: Setting Powered False 10:04:16.594118 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g iperf3.py ---------------------------------------------- 10:04:17.760145 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:17.771728 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:04:17.808778 tst iperf3.py: using LAC 20705 10:04:17.937790 tst iperf3.py: using RAC 50 10:04:18.066736 tst iperf3.py: using CellId 20705 10:04:18.198773 tst iperf3.py: using BVCI 20706 10:04:18.320321 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.331362 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.342351 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.353469 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.364258 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.375256 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.386498 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.397554 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:18.408762 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:18.529941 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:04:18.752323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:19.084060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23714): Launched 10:04:19.371844 run iperf3-srv_10.42.42.10(pid=23715): Launched 10:04:19.497206 tst iperf3.py:8: start network... 10:04:19.719336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:20.233489 run create_hlr_db(pid=23716): Launched 10:04:20.360564 bus /gobi_6: Setting Powered False 10:04:21.426031 run create_hlr_db(pid=23716): Terminated: ok {rc=0} 10:04:21.864757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23718): Launched 10:04:22.172275 run osmo-hlr_10.42.42.2(pid=23719): Launched 10:04:22.289796 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:22.837225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23721): Launched 10:04:23.144869 run osmo-stp_10.42.42.5(pid=23722): Launched 10:04:23.264548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:23.813878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23724): Launched 10:04:23.932665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:24.192551 run patchelf(pid=23725): Launched 10:04:24.363547 run osmo-stp_10.42.42.5(pid=23722): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23722)] 10:04:24.493327 run osmo-stp_10.42.42.5(pid=23722): stdout: | (launched: 2022-12-09_10:04:23.087995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:24.624606 run osmo-stp_10.42.42.5(pid=23722): stderr: | 20221209100423262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100423262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100423262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100423263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100423263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100423263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100423263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:24.755952 run osmo-stp_10.42.42.5(pid=23722): stdout: | (launched: 2022-12-09_10:04:23.087995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:24.882499 run osmo-stp_10.42.42.5(pid=23722): stderr: | 20221209100423262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100423262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100423262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100423263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100423263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100423263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100423263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:25.032087 run patchelf(pid=23725): Terminating (SIGINT) 10:04:25.204231 run patchelf(pid=23725): Terminated: ok {rc=0} 10:04:25.328070 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23722): Process ended prematurely: osmo-stp_10.42.42.5(pid=23722) [trial-2358↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23722)] [trial-2358↪gprs:oc2g↪iperf3.py:8] 10:04:25.337673 tst iperf3.py:8: Test FAILED (7.6 sec) 10:04:25.365197 run osmo-hlr_10.42.42.2(pid=23719): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23719)] 10:04:25.413603 run osmo-hlr_10.42.42.2(pid=23719): stdout: | (launched: 2022-12-09_10:04:22.115815) 10:04:25.463476 run osmo-hlr_10.42.42.2(pid=23719): stderr: | 20221209100422294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100422294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100422294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100422294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100422294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100422294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100422306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100422315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100422315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100422315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:25.514226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23714): Terminating (SIGTERM) 10:04:25.554463 run iperf3-srv_10.42.42.10(pid=23715): Terminating (SIGTERM) 10:04:25.594785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23718): Terminating (SIGTERM) 10:04:25.635149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23721): Terminating (SIGTERM) 10:04:25.675384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23724): Terminating (SIGTERM) 10:04:25.715650 --- ParallelTerminationStrategy: PID 23714 died... 10:04:25.734989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23714): Terminated: ok {rc=0} 10:04:25.779539 --- ParallelTerminationStrategy: PID 23715 died... 10:04:25.798303 run iperf3-srv_10.42.42.10(pid=23715): Terminated {rc=256} 10:04:25.842437 --- ParallelTerminationStrategy: PID 23718 died... 10:04:25.861306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23718): Terminated: ok {rc=0} 10:04:25.905501 --- ParallelTerminationStrategy: PID 23721 died... 10:04:25.924381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23721): Terminated: ok {rc=0} 10:04:25.968565 --- ParallelTerminationStrategy: PID 23724 died... 10:04:25.987362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23724): Terminated: ok {rc=0} 10:04:26.074138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g iperf3m4.py ---------------------------------------------- 10:04:27.222989 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.234294 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:04:27.270005 tst iperf3m4.py: using LAC 20706 10:04:27.400643 tst iperf3m4.py: using RAC 51 10:04:27.536086 tst iperf3m4.py: using CellId 20706 10:04:27.665216 tst iperf3m4.py: using BVCI 20707 10:04:27.777916 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.788371 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.798796 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.809682 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.820595 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.831539 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.842678 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.854081 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:27.864486 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:27.980348 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:28.103060 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:28.219414 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:28.338864 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:04:28.561405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:28.894687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23726): Launched 10:04:29.184605 run iperf3-srv_10.42.42.10(pid=23727): Launched 10:04:29.309403 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:04:29.532103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:29.864257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23728): Launched 10:04:30.153181 run iperf3-srv_10.42.42.10(pid=23729): Launched 10:04:30.279325 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:04:30.501240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:30.845918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23730): Launched 10:04:31.179170 run iperf3-srv_10.42.42.10(pid=23731): Launched 10:04:31.330186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:04:31.557235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:31.896242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23732): Launched 10:04:32.206745 run iperf3-srv_10.42.42.10(pid=23733): Launched 10:04:32.332455 tst iperf3m4.py:8: start network... 10:04:32.537647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:33.018257 run create_hlr_db(pid=23734): Launched 10:04:33.143927 bus /gobi_6: Setting Powered False 10:04:34.205209 run create_hlr_db(pid=23734): Terminated: ok {rc=0} 10:04:34.633231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23736): Launched 10:04:34.941506 run osmo-hlr_10.42.42.2(pid=23737): Launched 10:04:35.059469 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:35.604685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23739): Launched 10:04:35.912874 run osmo-stp_10.42.42.5(pid=23740): Launched 10:04:36.030863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:36.559353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23742): Launched 10:04:36.678213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:36.938270 run patchelf(pid=23743): Launched 10:04:37.111426 run osmo-stp_10.42.42.5(pid=23740): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23740)] 10:04:37.240887 run osmo-stp_10.42.42.5(pid=23740): stdout: | (launched: 2022-12-09_10:04:35.855767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:37.371670 run osmo-stp_10.42.42.5(pid=23740): stderr: | 20221209100436026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100436026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100436026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100436026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100436027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100436027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100436027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:37.502711 run osmo-stp_10.42.42.5(pid=23740): stdout: | (launched: 2022-12-09_10:04:35.855767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:37.628307 run osmo-stp_10.42.42.5(pid=23740): stderr: | 20221209100436026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100436026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100436026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100436026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100436027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100436027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100436027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:37.777100 run patchelf(pid=23743): Terminating (SIGINT) 10:04:37.948436 run patchelf(pid=23743): Terminated: ok {rc=0} 10:04:38.071800 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23740): Process ended prematurely: osmo-stp_10.42.42.5(pid=23740) [trial-2358↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23740)] [trial-2358↪gprs:oc2g↪iperf3m4.py:8] 10:04:38.081351 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:04:38.108921 run osmo-hlr_10.42.42.2(pid=23737): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23737)] 10:04:38.156799 run osmo-hlr_10.42.42.2(pid=23737): stdout: | (launched: 2022-12-09_10:04:34.884061) 10:04:38.206384 run osmo-hlr_10.42.42.2(pid=23737): stderr: | 20221209100435060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100435060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100435060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100435060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100435060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100435060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100435072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100435082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100435082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100435083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:38.256522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23726): Terminating (SIGTERM) 10:04:38.296744 run iperf3-srv_10.42.42.10(pid=23727): Terminating (SIGTERM) 10:04:38.336625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23728): Terminating (SIGTERM) 10:04:38.376721 run iperf3-srv_10.42.42.10(pid=23729): Terminating (SIGTERM) 10:04:38.416696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23730): Terminating (SIGTERM) 10:04:38.456727 run iperf3-srv_10.42.42.10(pid=23731): Terminating (SIGTERM) 10:04:38.496699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23732): Terminating (SIGTERM) 10:04:38.536591 run iperf3-srv_10.42.42.10(pid=23733): Terminating (SIGTERM) 10:04:38.576514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23736): Terminating (SIGTERM) 10:04:38.616682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23739): Terminating (SIGTERM) 10:04:38.656770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23742): Terminating (SIGTERM) 10:04:38.697299 --- ParallelTerminationStrategy: PID 23726 died... 10:04:38.716596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23726): Terminated: ok {rc=0} 10:04:38.761499 --- ParallelTerminationStrategy: PID 23727 died... 10:04:38.780234 run iperf3-srv_10.42.42.10(pid=23727): Terminated {rc=256} 10:04:38.824625 --- ParallelTerminationStrategy: PID 23728 died... 10:04:38.843555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23728): Terminated: ok {rc=0} 10:04:38.887933 --- ParallelTerminationStrategy: PID 23729 died... 10:04:38.906828 run iperf3-srv_10.42.42.10(pid=23729): Terminated {rc=256} 10:04:38.951120 --- ParallelTerminationStrategy: PID 23730 died... 10:04:38.970093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23730): Terminated: ok {rc=0} 10:04:39.014980 --- ParallelTerminationStrategy: PID 23731 died... 10:04:39.033985 run iperf3-srv_10.42.42.10(pid=23731): Terminated {rc=256} 10:04:39.078371 --- ParallelTerminationStrategy: PID 23732 died... 10:04:39.097375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23732): Terminated: ok {rc=0} 10:04:39.141725 --- ParallelTerminationStrategy: PID 23733 died... 10:04:39.160735 run iperf3-srv_10.42.42.10(pid=23733): Terminated {rc=256} 10:04:39.205086 --- ParallelTerminationStrategy: PID 23736 died... 10:04:39.223967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23736): Terminated: ok {rc=0} 10:04:39.268202 --- ParallelTerminationStrategy: PID 23739 died... 10:04:39.287294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23739): Terminated: ok {rc=0} 10:04:39.331550 --- ParallelTerminationStrategy: PID 23742 died... 10:04:39.350579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23742): Terminated: ok {rc=0} 10:04:39.437671 bus /gobi_4: Setting Powered False 10:04:40.538404 bus /gobi_4: Setting Powered False 10:04:41.654550 bus /gobi_1: Setting Powered False 10:04:42.755924 bus /gobi_1: Setting Powered False 10:04:43.872762 bus /gobi_0: Setting Powered False 10:04:44.971806 bus /gobi_0: Setting Powered False 10:04:46.091472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g ping.py ---------------------------------------------- 10:04:47.201274 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.216000 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:04:47.255547 tst ping.py: using LAC 20707 10:04:47.382937 tst ping.py: using RAC 52 10:04:47.511428 tst ping.py: using CellId 20707 10:04:47.631245 tst ping.py: using BVCI 20708 10:04:47.742207 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.752527 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.762970 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.773357 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.784007 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.794337 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.804609 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:47.814883 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:47.928351 tst ping.py:19: start network... 10:04:48.131174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:48.598901 run create_hlr_db(pid=23744): Launched 10:04:48.723844 bus /gobi_6: Setting Powered False 10:04:49.783574 run create_hlr_db(pid=23744): Terminated: ok {rc=0} 10:04:50.204646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23746): Launched 10:04:50.506621 run osmo-hlr_10.42.42.2(pid=23747): Launched 10:04:50.621281 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:51.163275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23749): Launched 10:04:51.465633 run osmo-stp_10.42.42.5(pid=23750): Launched 10:04:51.582131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:52.105383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23752): Launched 10:04:52.220401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:52.475802 run patchelf(pid=23753): Launched 10:04:52.644128 run osmo-stp_10.42.42.5(pid=23750): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23750)] 10:04:52.772045 run osmo-stp_10.42.42.5(pid=23750): stdout: | (launched: 2022-12-09_10:04:51.409557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:52.901527 run osmo-stp_10.42.42.5(pid=23750): stderr: | 20221209100451578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100451579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100451579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100451579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100451580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100451580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100451580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:53.030496 run osmo-stp_10.42.42.5(pid=23750): stdout: | (launched: 2022-12-09_10:04:51.409557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:53.155097 run osmo-stp_10.42.42.5(pid=23750): stderr: | 20221209100451578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100451579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100451579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100451579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100451580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100451580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100451580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:53.301927 run patchelf(pid=23753): Terminating (SIGINT) 10:04:53.470442 run patchelf(pid=23753): Terminated: ok {rc=0} 10:04:53.592236 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23750): Process ended prematurely: osmo-stp_10.42.42.5(pid=23750) [trial-2358↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23750)] [trial-2358↪gprs:oc2g↪ping.py:22] 10:04:53.601196 tst ping.py:22: Test FAILED (6.4 sec) 10:04:53.628478 run osmo-hlr_10.42.42.2(pid=23747): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23747)] 10:04:53.676605 run osmo-hlr_10.42.42.2(pid=23747): stdout: | (launched: 2022-12-09_10:04:50.450441) 10:04:53.726639 run osmo-hlr_10.42.42.2(pid=23747): stderr: | 20221209100450629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100450629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100450629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100450629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100450629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100450629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100450641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100450650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100450650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100450650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:53.777100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23746): Terminating (SIGTERM) 10:04:53.817365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23749): Terminating (SIGTERM) 10:04:53.857566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23752): Terminating (SIGTERM) 10:04:53.898032 --- ParallelTerminationStrategy: PID 23746 died... 10:04:53.917012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23746): Terminated: ok {rc=0} 10:04:53.961313 --- ParallelTerminationStrategy: PID 23749 died... 10:04:53.980312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23749): Terminated: ok {rc=0} 10:04:54.024897 --- ParallelTerminationStrategy: PID 23752 died... 10:04:54.043892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23752): Terminated: ok {rc=0} 10:04:54.130498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 10:04:55.220607 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.232227 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:04:55.268764 tst ping_idle_ping.py: using LAC 20708 10:04:55.388388 tst ping_idle_ping.py: using RAC 53 10:04:55.518295 tst ping_idle_ping.py: using CellId 20708 10:04:55.649048 tst ping_idle_ping.py: using BVCI 20709 10:04:55.768656 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.779856 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.790949 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.802793 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.814365 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.825947 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.837627 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:04:55.849174 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:04:55.966464 tst ping_idle_ping.py:24: start network... 10:04:56.169128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:56.641997 run create_hlr_db(pid=23754): Launched 10:04:56.769783 bus /gobi_6: Setting Powered False 10:04:57.830600 run create_hlr_db(pid=23754): Terminated: ok {rc=0} 10:04:58.277389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Launched 10:04:58.605680 run osmo-hlr_10.42.42.2(pid=23757): Launched 10:04:58.732008 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:59.297924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Launched 10:04:59.623664 run osmo-stp_10.42.42.5(pid=23760): Launched 10:04:59.749409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:00.311320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23762): Launched 10:05:00.437529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:00.712710 run patchelf(pid=23763): Launched 10:05:00.909285 run osmo-stp_10.42.42.5(pid=23760): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] 10:05:01.049788 run osmo-stp_10.42.42.5(pid=23760): stdout: | (launched: 2022-12-09_10:04:59.563564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:01.192129 run osmo-stp_10.42.42.5(pid=23760): stderr: | 20221209100459757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100459757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100459757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100459758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100459758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100459758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100459758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:01.372102 run osmo-stp_10.42.42.5(pid=23760): stdout: | (launched: 2022-12-09_10:04:59.563564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:01.551030 run osmo-stp_10.42.42.5(pid=23760): stderr: | 20221209100459757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100459757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100459757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100459758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100459758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100459758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100459758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:01.728904 run patchelf(pid=23763): Terminating (SIGINT) 10:05:01.915283 run patchelf(pid=23763): Terminated: ok {rc=0} 10:05:02.049881 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23760): Process ended prematurely: osmo-stp_10.42.42.5(pid=23760) [trial-2358↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] [trial-2358↪gprs:oc2g↪ping_idle_ping.py:27] 10:05:02.060777 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:05:02.093399 run osmo-hlr_10.42.42.2(pid=23757): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23757)] 10:05:02.146818 run osmo-hlr_10.42.42.2(pid=23757): stdout: | (launched: 2022-12-09_10:04:58.545138) 10:05:02.202287 run osmo-hlr_10.42.42.2(pid=23757): stderr: | 20221209100458746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100458747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100458747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100458747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100458747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100458747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100458763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100458773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100458774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100458774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:02.258085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Terminating (SIGTERM) 10:05:02.302924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Terminating (SIGTERM) 10:05:02.347325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23762): Terminating (SIGTERM) 10:05:02.390637 --- ParallelTerminationStrategy: PID 23756 died... 10:05:02.411014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Terminated: ok {rc=0} 10:05:02.458902 --- ParallelTerminationStrategy: PID 23759 died... 10:05:02.478781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Terminated: ok {rc=0} 10:05:02.527184 --- ParallelTerminationStrategy: PID 23762 died... 10:05:02.547285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23762): Terminated: ok {rc=0} 10:05:02.636842 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 10:05:03.935335 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:05:03.941460 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:05:03.963421 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:05:04.003260 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:05:04.091262 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:05:04.112211 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:05:04.151460 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:05:04.744533 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:05:04.797510 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:04.808527 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:05:04.846325 tst cs_paging_gprs_active.py: using LAC 20709 10:05:04.974759 tst cs_paging_gprs_active.py: using RAC 54 10:05:05.103234 tst cs_paging_gprs_active.py: using CellId 20709 10:05:05.232002 tst cs_paging_gprs_active.py: using BVCI 20710 10:05:05.350954 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.362096 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.373064 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.384192 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.395443 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.406705 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.418722 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.430179 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:05.441698 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:05.560635 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:05.674628 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:05:05.878205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:06.184173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Launched 10:05:06.448712 run iperf3-srv_10.42.42.10(pid=23771): Launched 10:05:06.562373 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:05:06.764663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:07.069296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23772): Launched 10:05:07.335206 run iperf3-srv_10.42.42.10(pid=23773): Launched 10:05:07.449106 tst cs_paging_gprs_active.py:38: start network... 10:05:07.651687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:08.125450 run create_hlr_db(pid=23774): Launched 10:05:08.252888 bus /gobi_6: Setting Powered False 10:05:09.317406 run create_hlr_db(pid=23774): Terminated: ok {rc=0} 10:05:09.755998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23776): Launched 10:05:10.060298 run osmo-hlr_10.42.42.2(pid=23777): Launched 10:05:10.176740 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:10.702792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23779): Launched 10:05:11.007710 run osmo-stp_10.42.42.5(pid=23780): Launched 10:05:11.125336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:11.649709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23782): Launched 10:05:11.765314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:12.022223 run patchelf(pid=23783): Launched 10:05:12.190807 run osmo-stp_10.42.42.5(pid=23780): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23780)] 10:05:12.319679 run osmo-stp_10.42.42.5(pid=23780): stdout: | (launched: 2022-12-09_10:05:10.950630) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:12.449965 run osmo-stp_10.42.42.5(pid=23780): stderr: | 20221209100511121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100511122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100511122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100511122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100511123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100511123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100511123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:12.580407 run osmo-stp_10.42.42.5(pid=23780): stdout: | (launched: 2022-12-09_10:05:10.950630) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:12.705609 run osmo-stp_10.42.42.5(pid=23780): stderr: | 20221209100511121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100511122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100511122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100511122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100511123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100511123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100511123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:12.853830 run patchelf(pid=23783): Terminating (SIGINT) 10:05:13.024167 run patchelf(pid=23783): Terminated: ok {rc=0} 10:05:13.147230 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23780): Process ended prematurely: osmo-stp_10.42.42.5(pid=23780) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23780)] [trial-2358↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:05:13.156905 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:05:13.184327 run osmo-hlr_10.42.42.2(pid=23777): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23777)] 10:05:13.232823 run osmo-hlr_10.42.42.2(pid=23777): stdout: | (launched: 2022-12-09_10:05:10.004086) 10:05:13.283402 run osmo-hlr_10.42.42.2(pid=23777): stderr: | 20221209100510178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100510178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100510178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100510178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100510179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100510179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100510191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100510199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100510199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100510199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:13.334082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Terminating (SIGTERM) 10:05:13.374650 run iperf3-srv_10.42.42.10(pid=23771): Terminating (SIGTERM) 10:05:13.415155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23772): Terminating (SIGTERM) 10:05:13.455683 run iperf3-srv_10.42.42.10(pid=23773): Terminating (SIGTERM) 10:05:13.496136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23776): Terminating (SIGTERM) 10:05:13.536677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23779): Terminating (SIGTERM) 10:05:13.577104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23782): Terminating (SIGTERM) 10:05:13.618316 --- ParallelTerminationStrategy: PID 23770 died... 10:05:13.637627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Terminated: ok {rc=0} 10:05:13.682357 --- ParallelTerminationStrategy: PID 23771 died... 10:05:13.701240 run iperf3-srv_10.42.42.10(pid=23771): Terminated {rc=256} 10:05:13.745622 --- ParallelTerminationStrategy: PID 23772 died... 10:05:13.764369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23772): Terminated: ok {rc=0} 10:05:13.808707 --- ParallelTerminationStrategy: PID 23773 died... 10:05:13.827469 run iperf3-srv_10.42.42.10(pid=23773): Terminated {rc=256} 10:05:13.871779 --- ParallelTerminationStrategy: PID 23776 died... 10:05:13.890679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23776): Terminated: ok {rc=0} 10:05:13.935006 --- ParallelTerminationStrategy: PID 23779 died... 10:05:13.953847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23779): Terminated: ok {rc=0} 10:05:13.998217 --- ParallelTerminationStrategy: PID 23782 died... 10:05:14.017152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23782): Terminated: ok {rc=0} 10:05:14.103877 bus /gobi_0: Setting Powered False 10:05:15.206162 bus /gobi_0: Setting Powered False 10:05:16.328730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:05:17.488422 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:17.500468 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:05:17.538585 tst iperf3.py: using LAC 20710 10:05:17.668234 tst iperf3.py: using RAC 55 10:05:17.797456 tst iperf3.py: using CellId 20710 10:05:17.925140 tst iperf3.py: using BVCI 20711 10:05:18.044755 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.056116 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.067428 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.078890 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.090225 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.101586 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.113065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.124168 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:18.135733 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:18.254994 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:05:18.473243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:18.799155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23784): Launched 10:05:19.082655 run iperf3-srv_10.42.42.10(pid=23785): Launched 10:05:19.205766 tst iperf3.py:8: start network... 10:05:19.423693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:19.927292 run create_hlr_db(pid=23786): Launched 10:05:20.050310 bus /gobi_6: Setting Powered False 10:05:21.114116 run create_hlr_db(pid=23786): Terminated: ok {rc=0} 10:05:21.565696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23788): Launched 10:05:21.889487 run osmo-hlr_10.42.42.2(pid=23789): Launched 10:05:22.014333 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:22.578719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23791): Launched 10:05:22.904899 run osmo-stp_10.42.42.5(pid=23792): Launched 10:05:23.031336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:23.593577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23794): Launched 10:05:23.719417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:23.995552 run patchelf(pid=23795): Launched 10:05:24.175631 run osmo-stp_10.42.42.5(pid=23792): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23792)] 10:05:24.313466 run osmo-stp_10.42.42.5(pid=23792): stdout: | (launched: 2022-12-09_10:05:22.845354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:24.452747 run osmo-stp_10.42.42.5(pid=23792): stderr: | 20221209100523038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100523038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100523039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100523039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100523039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100523040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100523040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:24.591740 run osmo-stp_10.42.42.5(pid=23792): stdout: | (launched: 2022-12-09_10:05:22.845354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:24.725811 run osmo-stp_10.42.42.5(pid=23792): stderr: | 20221209100523038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100523038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100523039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100523039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100523039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100523040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100523040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:24.883942 run patchelf(pid=23795): Terminating (SIGINT) 10:05:25.066019 run patchelf(pid=23795): Terminated: ok {rc=0} 10:05:25.197416 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23792): Process ended prematurely: osmo-stp_10.42.42.5(pid=23792) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23792)] [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 10:05:25.208211 tst iperf3.py:8: Test FAILED (7.8 sec) 10:05:25.237586 run osmo-hlr_10.42.42.2(pid=23789): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23789)] 10:05:25.288882 run osmo-hlr_10.42.42.2(pid=23789): stdout: | (launched: 2022-12-09_10:05:21.830064) 10:05:25.342118 run osmo-hlr_10.42.42.2(pid=23789): stderr: | 20221209100522027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100522027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100522027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100522027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100522027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100522027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100522040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100522048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100522048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100522048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:25.395450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23784): Terminating (SIGTERM) 10:05:25.437927 run iperf3-srv_10.42.42.10(pid=23785): Terminating (SIGTERM) 10:05:25.480420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23788): Terminating (SIGTERM) 10:05:25.523019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23791): Terminating (SIGTERM) 10:05:25.565614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23794): Terminating (SIGTERM) 10:05:25.608287 --- ParallelTerminationStrategy: PID 23784 died... 10:05:25.628400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23784): Terminated: ok {rc=0} 10:05:25.675420 --- ParallelTerminationStrategy: PID 23785 died... 10:05:25.694996 run iperf3-srv_10.42.42.10(pid=23785): Terminated {rc=256} 10:05:25.741872 --- ParallelTerminationStrategy: PID 23788 died... 10:05:25.761583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23788): Terminated: ok {rc=0} 10:05:25.808697 --- ParallelTerminationStrategy: PID 23791 died... 10:05:25.828555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23791): Terminated: ok {rc=0} 10:05:25.875581 --- ParallelTerminationStrategy: PID 23794 died... 10:05:25.895206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23794): Terminated: ok {rc=0} 10:05:25.984446 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:05:27.136641 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.148685 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:05:27.187396 tst iperf3m4.py: using LAC 20711 10:05:27.317361 tst iperf3m4.py: using RAC 56 10:05:27.445446 tst iperf3m4.py: using CellId 20711 10:05:27.567329 tst iperf3m4.py: using BVCI 20712 10:05:27.679580 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.690890 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.701764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.713175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.724549 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.735563 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.746877 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.760030 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:27.772938 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:27.891930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:28.013384 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:28.131344 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:28.250941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:05:28.470770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:28.799427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Launched 10:05:29.083982 run iperf3-srv_10.42.42.10(pid=23797): Launched 10:05:29.206420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:05:29.425927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:29.752281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23798): Launched 10:05:30.035028 run iperf3-srv_10.42.42.10(pid=23799): Launched 10:05:30.158933 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:05:30.377968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:30.704345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23800): Launched 10:05:31.012805 run iperf3-srv_10.42.42.10(pid=23801): Launched 10:05:31.151305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:05:31.359867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:31.677200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23802): Launched 10:05:31.963828 run iperf3-srv_10.42.42.10(pid=23803): Launched 10:05:32.096347 tst iperf3m4.py:8: start network... 10:05:32.303313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:32.779580 run create_hlr_db(pid=23804): Launched 10:05:32.903653 bus /gobi_6: Setting Powered False 10:05:33.964420 run create_hlr_db(pid=23804): Terminated: ok {rc=0} 10:05:34.410133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23806): Launched 10:05:34.737883 run osmo-hlr_10.42.42.2(pid=23807): Launched 10:05:34.863837 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:35.427149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23809): Launched 10:05:35.754264 run osmo-stp_10.42.42.5(pid=23810): Launched 10:05:35.879453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:36.442183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23812): Launched 10:05:36.570431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:36.847226 run patchelf(pid=23813): Launched 10:05:37.030546 run osmo-stp_10.42.42.5(pid=23810): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23810)] 10:05:37.168833 run osmo-stp_10.42.42.5(pid=23810): stdout: | (launched: 2022-12-09_10:05:35.694469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:37.309567 run osmo-stp_10.42.42.5(pid=23810): stderr: | 20221209100535882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100535883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100535883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100535883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100535884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100535884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100535884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:37.449667 run osmo-stp_10.42.42.5(pid=23810): stdout: | (launched: 2022-12-09_10:05:35.694469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:37.584214 run osmo-stp_10.42.42.5(pid=23810): stderr: | 20221209100535882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100535883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100535883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100535883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100535884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100535884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100535884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:37.743225 run patchelf(pid=23813): Terminating (SIGINT) 10:05:37.925415 run patchelf(pid=23813): Terminated: ok {rc=0} 10:05:38.056872 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23810): Process ended prematurely: osmo-stp_10.42.42.5(pid=23810) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23810)] [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 10:05:38.067619 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:05:38.097651 run osmo-hlr_10.42.42.2(pid=23807): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23807)] 10:05:38.149504 run osmo-hlr_10.42.42.2(pid=23807): stdout: | (launched: 2022-12-09_10:05:34.677976) 10:05:38.202846 run osmo-hlr_10.42.42.2(pid=23807): stderr: | 20221209100534874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100534874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100534874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100534874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100534874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100534874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100534887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100534898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100534898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100534898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:38.256906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Terminating (SIGTERM) 10:05:38.300299 run iperf3-srv_10.42.42.10(pid=23797): Terminating (SIGTERM) 10:05:38.343606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23798): Terminating (SIGTERM) 10:05:38.386842 run iperf3-srv_10.42.42.10(pid=23799): Terminating (SIGTERM) 10:05:38.430044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23800): Terminating (SIGTERM) 10:05:38.473307 run iperf3-srv_10.42.42.10(pid=23801): Terminating (SIGTERM) 10:05:38.516404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23802): Terminating (SIGTERM) 10:05:38.559525 run iperf3-srv_10.42.42.10(pid=23803): Terminating (SIGTERM) 10:05:38.602745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23806): Terminating (SIGTERM) 10:05:38.645975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23809): Terminating (SIGTERM) 10:05:38.689464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23812): Terminating (SIGTERM) 10:05:38.732679 --- ParallelTerminationStrategy: PID 23796 died... 10:05:38.753118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Terminated: ok {rc=0} 10:05:38.801432 --- ParallelTerminationStrategy: PID 23797 died... 10:05:38.821498 run iperf3-srv_10.42.42.10(pid=23797): Terminated {rc=256} 10:05:38.869400 --- ParallelTerminationStrategy: PID 23798 died... 10:05:38.889438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23798): Terminated: ok {rc=0} 10:05:38.937577 --- ParallelTerminationStrategy: PID 23799 died... 10:05:38.957697 run iperf3-srv_10.42.42.10(pid=23799): Terminated {rc=256} 10:05:39.005428 --- ParallelTerminationStrategy: PID 23800 died... 10:05:39.025590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23800): Terminated: ok {rc=0} 10:05:39.073546 --- ParallelTerminationStrategy: PID 23801 died... 10:05:39.093693 run iperf3-srv_10.42.42.10(pid=23801): Terminated {rc=256} 10:05:39.141475 --- ParallelTerminationStrategy: PID 23802 died... 10:05:39.161485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23802): Terminated: ok {rc=0} 10:05:39.209247 --- ParallelTerminationStrategy: PID 23803 died... 10:05:39.229612 run iperf3-srv_10.42.42.10(pid=23803): Terminated {rc=256} 10:05:39.277524 --- ParallelTerminationStrategy: PID 23806 died... 10:05:39.297571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23806): Terminated: ok {rc=0} 10:05:39.345253 --- ParallelTerminationStrategy: PID 23809 died... 10:05:39.365114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23809): Terminated: ok {rc=0} 10:05:39.413054 --- ParallelTerminationStrategy: PID 23812 died... 10:05:39.433300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23812): Terminated: ok {rc=0} 10:05:39.523519 bus /gobi_4: Setting Powered False 10:05:40.624050 bus /gobi_4: Setting Powered False 10:05:41.744472 bus /gobi_1: Setting Powered False 10:05:42.846878 bus /gobi_1: Setting Powered False 10:05:43.966370 bus /gobi_0: Setting Powered False 10:05:45.065200 bus /gobi_0: Setting Powered False 10:05:46.182788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 10:05:47.292129 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.303997 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:05:47.343573 tst ping.py: using LAC 20712 10:05:47.470953 tst ping.py: using RAC 57 10:05:47.598417 tst ping.py: using CellId 20712 10:05:47.725312 tst ping.py: using BVCI 20713 10:05:47.843102 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.854365 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.865480 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.876788 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.888187 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.899463 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.911543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:47.923570 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:48.038252 tst ping.py:19: start network... 10:05:48.237049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:48.699175 run create_hlr_db(pid=23814): Launched 10:05:48.821406 bus /gobi_6: Setting Powered False 10:05:49.884761 run create_hlr_db(pid=23814): Terminated: ok {rc=0} 10:05:50.331467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23816): Launched 10:05:50.652023 run osmo-hlr_10.42.42.2(pid=23817): Launched 10:05:50.773849 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:51.332066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23819): Launched 10:05:51.652177 run osmo-stp_10.42.42.5(pid=23820): Launched 10:05:51.774555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:52.331077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23822): Launched 10:05:52.454297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:52.724017 run patchelf(pid=23823): Launched 10:05:52.903204 run osmo-stp_10.42.42.5(pid=23820): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23820)] 10:05:53.039097 run osmo-stp_10.42.42.5(pid=23820): stdout: | (launched: 2022-12-09_10:05:51.593280) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:53.175975 run osmo-stp_10.42.42.5(pid=23820): stderr: | 20221209100551784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100551784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100551784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100551784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100551785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100551785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100551785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:53.313850 run osmo-stp_10.42.42.5(pid=23820): stdout: | (launched: 2022-12-09_10:05:51.593280) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:53.445250 run osmo-stp_10.42.42.5(pid=23820): stderr: | 20221209100551784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100551784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100551784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100551784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100551785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100551785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100551785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:53.601108 run patchelf(pid=23823): Terminating (SIGINT) 10:05:53.780176 run patchelf(pid=23823): Terminated: ok {rc=0} 10:05:53.909335 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23820): Process ended prematurely: osmo-stp_10.42.42.5(pid=23820) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23820)] [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 10:05:53.919063 tst ping.py:22: Test FAILED (6.6 sec) 10:05:53.947875 run osmo-hlr_10.42.42.2(pid=23817): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23817)] 10:05:53.999460 run osmo-hlr_10.42.42.2(pid=23817): stdout: | (launched: 2022-12-09_10:05:50.593197) 10:05:54.052296 run osmo-hlr_10.42.42.2(pid=23817): stderr: | 20221209100550794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100550794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100550794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100550794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100550794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100550794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100550807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100550817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100550817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100550817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:54.105741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23816): Terminating (SIGTERM) 10:05:54.148367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23819): Terminating (SIGTERM) 10:05:54.191088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23822): Terminating (SIGTERM) 10:05:54.234366 --- ParallelTerminationStrategy: PID 23816 died... 10:05:54.254747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23816): Terminated: ok {rc=0} 10:05:54.302301 --- ParallelTerminationStrategy: PID 23819 died... 10:05:54.322305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23819): Terminated: ok {rc=0} 10:05:54.369567 --- ParallelTerminationStrategy: PID 23822 died... 10:05:54.389515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23822): Terminated: ok {rc=0} 10:05:54.478251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:05:55.566820 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:55.578529 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:05:55.617242 tst ping_idle_ping.py: using LAC 20713 10:05:55.735053 tst ping_idle_ping.py: using RAC 58 10:05:55.853345 tst ping_idle_ping.py: using CellId 20713 10:05:55.973512 tst ping_idle_ping.py: using BVCI 20714 10:05:56.082601 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.093516 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.104282 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.115276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.126320 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.136896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.147492 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:05:56.158084 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:05:56.272514 tst ping_idle_ping.py:24: start network... 10:05:56.472536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:56.938917 run create_hlr_db(pid=23824): Launched 10:05:57.061353 bus /gobi_6: Setting Powered False 10:05:58.121420 run create_hlr_db(pid=23824): Terminated: ok {rc=0} 10:05:58.541481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23826): Launched 10:05:58.844044 run osmo-hlr_10.42.42.2(pid=23827): Launched 10:05:58.958325 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:59.491671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23829): Launched 10:05:59.791892 run osmo-stp_10.42.42.5(pid=23830): Launched 10:05:59.905900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:00.422218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23832): Launched 10:06:00.538489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:00.790869 run patchelf(pid=23833): Launched 10:06:00.967462 run osmo-stp_10.42.42.5(pid=23830): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23830)] 10:06:01.096303 run osmo-stp_10.42.42.5(pid=23830): stdout: | (launched: 2022-12-09_10:05:59.736340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:01.266181 run osmo-stp_10.42.42.5(pid=23830): stderr: | 20221209100559907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100559907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100559908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100559908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100559908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100559909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100559909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:01.433955 run osmo-stp_10.42.42.5(pid=23830): stdout: | (launched: 2022-12-09_10:05:59.736340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:01.559948 run osmo-stp_10.42.42.5(pid=23830): stderr: | 20221209100559907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100559907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100559908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100559908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100559908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100559909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100559909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:01.710452 run patchelf(pid=23833): Terminating (SIGINT) 10:06:01.883387 run patchelf(pid=23833): Terminated: ok {rc=0} 10:06:02.007585 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23830): Process ended prematurely: osmo-stp_10.42.42.5(pid=23830) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23830)] [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 10:06:02.017910 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:06:02.047407 run osmo-hlr_10.42.42.2(pid=23827): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23827)] 10:06:02.097712 run osmo-hlr_10.42.42.2(pid=23827): stdout: | (launched: 2022-12-09_10:05:58.787969) 10:06:02.149595 run osmo-hlr_10.42.42.2(pid=23827): stderr: | 20221209100558962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100558962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100558962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100558962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100558962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100558962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100558973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100558982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100558982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100558982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:02.201942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23826): Terminating (SIGTERM) 10:06:02.243409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23829): Terminating (SIGTERM) 10:06:02.283613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23832): Terminating (SIGTERM) 10:06:02.324133 --- ParallelTerminationStrategy: PID 23826 died... 10:06:02.343530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23826): Terminated: ok {rc=0} 10:06:02.388014 --- ParallelTerminationStrategy: PID 23829 died... 10:06:02.406657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23829): Terminated: ok {rc=0} 10:06:02.451236 --- ParallelTerminationStrategy: PID 23832 died... 10:06:02.470166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23832): Terminated: ok {rc=0} 10:06:02.556675 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:06:03.848637 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:03.854991 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:06:03.875561 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:06:03.913535 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:06:04.003834 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:06:04.026178 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:06:04.064010 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:06:04.649482 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:06:04.698665 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:04.709729 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:06:04.764878 tst cs_paging_gprs_active.py: using LAC 20714 10:06:04.883605 tst cs_paging_gprs_active.py: using RAC 59 10:06:05.003445 tst cs_paging_gprs_active.py: using CellId 20714 10:06:05.122881 tst cs_paging_gprs_active.py: using BVCI 20715 10:06:05.235136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.246396 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.257238 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.267925 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.278670 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.289429 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.300262 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.310989 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:05.321910 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:05.443242 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:05.563096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:06:05.783982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:06.111885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23838): Launched 10:06:06.396626 run iperf3-srv_10.42.42.10(pid=23839): Launched 10:06:06.519241 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:06:06.738908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:07.066938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23840): Launched 10:06:07.353195 run iperf3-srv_10.42.42.10(pid=23841): Launched 10:06:07.475346 tst cs_paging_gprs_active.py:38: start network... 10:06:07.695168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:08.202188 run create_hlr_db(pid=23842): Launched 10:06:08.328161 bus /gobi_6: Setting Powered False 10:06:09.392847 run create_hlr_db(pid=23842): Terminated: ok {rc=0} 10:06:09.847765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23844): Launched 10:06:10.173697 run osmo-hlr_10.42.42.2(pid=23845): Launched 10:06:10.298642 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:10.865173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23847): Launched 10:06:11.190329 run osmo-stp_10.42.42.5(pid=23848): Launched 10:06:11.316269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:11.878960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23850): Launched 10:06:12.004336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:12.283390 run patchelf(pid=23856): Launched 10:06:12.465449 run osmo-stp_10.42.42.5(pid=23848): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23848)] 10:06:12.603846 run osmo-stp_10.42.42.5(pid=23848): stdout: | (launched: 2022-12-09_10:06:11.130627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:12.743812 run osmo-stp_10.42.42.5(pid=23848): stderr: | 20221209100611319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100611319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100611320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100611320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100611321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100611321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100611321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:12.883940 run osmo-stp_10.42.42.5(pid=23848): stdout: | (launched: 2022-12-09_10:06:11.130627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:13.018404 run osmo-stp_10.42.42.5(pid=23848): stderr: | 20221209100611319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100611319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100611320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100611320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100611321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100611321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100611321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:13.177614 run patchelf(pid=23856): Terminating (SIGINT) 10:06:13.361477 run patchelf(pid=23856): Terminated: ok {rc=0} 10:06:13.493667 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23848): Process ended prematurely: osmo-stp_10.42.42.5(pid=23848) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23848)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:06:13.503863 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:06:13.532855 run osmo-hlr_10.42.42.2(pid=23845): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23845)] 10:06:13.584162 run osmo-hlr_10.42.42.2(pid=23845): stdout: | (launched: 2022-12-09_10:06:10.113738) 10:06:13.636898 run osmo-hlr_10.42.42.2(pid=23845): stderr: | 20221209100610313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100610313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100610313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100610313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100610313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100610313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100610326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100610334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100610334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100610334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:13.690077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23838): Terminating (SIGTERM) 10:06:13.732150 run iperf3-srv_10.42.42.10(pid=23839): Terminating (SIGTERM) 10:06:13.775250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23840): Terminating (SIGTERM) 10:06:13.817823 run iperf3-srv_10.42.42.10(pid=23841): Terminating (SIGTERM) 10:06:13.860309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23844): Terminating (SIGTERM) 10:06:13.903005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23847): Terminating (SIGTERM) 10:06:13.945371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23850): Terminating (SIGTERM) 10:06:13.987993 --- ParallelTerminationStrategy: PID 23838 died... 10:06:14.008113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23838): Terminated: ok {rc=0} 10:06:14.055262 --- ParallelTerminationStrategy: PID 23839 died... 10:06:14.074886 run iperf3-srv_10.42.42.10(pid=23839): Terminated {rc=256} 10:06:14.121498 --- ParallelTerminationStrategy: PID 23840 died... 10:06:14.141121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23840): Terminated: ok {rc=0} 10:06:14.188148 --- ParallelTerminationStrategy: PID 23841 died... 10:06:14.207625 run iperf3-srv_10.42.42.10(pid=23841): Terminated {rc=256} 10:06:14.255032 --- ParallelTerminationStrategy: PID 23844 died... 10:06:14.274755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23844): Terminated: ok {rc=0} 10:06:14.321537 --- ParallelTerminationStrategy: PID 23847 died... 10:06:14.341121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23847): Terminated: ok {rc=0} 10:06:14.387690 --- ParallelTerminationStrategy: PID 23850 died... 10:06:14.407292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23850): Terminated: ok {rc=0} 10:06:14.495677 bus /gobi_0: Setting Powered False 10:06:15.596058 bus /gobi_0: Setting Powered False 10:06:16.720228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:06:17.884537 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:17.896696 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:06:17.957691 tst iperf3.py: using LAC 20715 10:06:18.077381 tst iperf3.py: using RAC 60 10:06:18.197059 tst iperf3.py: using CellId 20715 10:06:18.316305 tst iperf3.py: using BVCI 20716 10:06:18.427011 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.437907 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.448403 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.459517 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.470603 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.481686 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.492775 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.503919 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:18.515086 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:18.630996 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:06:18.834146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:19.138167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23859): Launched 10:06:19.402218 run iperf3-srv_10.42.42.10(pid=23860): Launched 10:06:19.515475 tst iperf3.py:8: start network... 10:06:19.717451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:20.190364 run create_hlr_db(pid=23861): Launched 10:06:20.314405 bus /gobi_6: Setting Powered False 10:06:21.374233 run create_hlr_db(pid=23861): Terminated: ok {rc=0} 10:06:21.818181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23863): Launched 10:06:22.144450 run osmo-hlr_10.42.42.2(pid=23864): Launched 10:06:22.269341 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:22.828328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23866): Launched 10:06:23.153304 run osmo-stp_10.42.42.5(pid=23867): Launched 10:06:23.277443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:23.838026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23869): Launched 10:06:23.962995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:24.238001 run patchelf(pid=23870): Launched 10:06:24.421199 run osmo-stp_10.42.42.5(pid=23867): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23867)] 10:06:24.559260 run osmo-stp_10.42.42.5(pid=23867): stdout: | (launched: 2022-12-09_10:06:23.093279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:24.699058 run osmo-stp_10.42.42.5(pid=23867): stderr: | 20221209100623286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100623286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100623286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100623287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100623287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100623287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100623287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:24.839278 run osmo-stp_10.42.42.5(pid=23867): stdout: | (launched: 2022-12-09_10:06:23.093279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:24.973633 run osmo-stp_10.42.42.5(pid=23867): stderr: | 20221209100623286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100623286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100623286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100623287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100623287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100623287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100623287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:25.132494 run patchelf(pid=23870): Terminating (SIGINT) 10:06:25.315899 run patchelf(pid=23870): Terminated: ok {rc=0} 10:06:25.448081 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23867): Process ended prematurely: osmo-stp_10.42.42.5(pid=23867) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23867)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 10:06:25.458475 tst iperf3.py:8: Test FAILED (7.6 sec) 10:06:25.487664 run osmo-hlr_10.42.42.2(pid=23864): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23864)] 10:06:25.538529 run osmo-hlr_10.42.42.2(pid=23864): stdout: | (launched: 2022-12-09_10:06:22.084465) 10:06:25.591399 run osmo-hlr_10.42.42.2(pid=23864): stderr: | 20221209100622285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100622285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100622285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100622285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100622285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100622285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100622300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100622308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100622308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100622308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:25.644717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23859): Terminating (SIGTERM) 10:06:25.687298 run iperf3-srv_10.42.42.10(pid=23860): Terminating (SIGTERM) 10:06:25.729691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23863): Terminating (SIGTERM) 10:06:25.772244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23866): Terminating (SIGTERM) 10:06:25.814659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23869): Terminating (SIGTERM) 10:06:25.857232 --- ParallelTerminationStrategy: PID 23859 died... 10:06:25.877334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23859): Terminated: ok {rc=0} 10:06:25.924848 --- ParallelTerminationStrategy: PID 23860 died... 10:06:25.944559 run iperf3-srv_10.42.42.10(pid=23860): Terminated {rc=256} 10:06:25.991774 --- ParallelTerminationStrategy: PID 23863 died... 10:06:26.011767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23863): Terminated: ok {rc=0} 10:06:26.058516 --- ParallelTerminationStrategy: PID 23866 died... 10:06:26.078094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23866): Terminated: ok {rc=0} 10:06:26.124733 --- ParallelTerminationStrategy: PID 23869 died... 10:06:26.144406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23869): Terminated: ok {rc=0} 10:06:26.234586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:06:27.382123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.393539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:06:27.447853 tst iperf3m4.py: using LAC 20716 10:06:27.565570 tst iperf3m4.py: using RAC 61 10:06:27.686064 tst iperf3m4.py: using CellId 20716 10:06:27.808087 tst iperf3m4.py: using BVCI 20717 10:06:27.920609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.931608 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.942258 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.952832 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.963295 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.973799 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.984537 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:27.994983 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:28.005686 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:28.125589 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:28.244306 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:28.364578 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:28.486081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:06:28.706199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:29.034230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23871): Launched 10:06:29.319031 run iperf3-srv_10.42.42.10(pid=23872): Launched 10:06:29.441588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:06:29.660186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:29.987571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23873): Launched 10:06:30.272009 run iperf3-srv_10.42.42.10(pid=23874): Launched 10:06:30.396129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:06:30.615327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:30.953631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23875): Launched 10:06:31.244337 run iperf3-srv_10.42.42.10(pid=23876): Launched 10:06:31.376296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:06:31.585153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:31.904299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23877): Launched 10:06:32.234790 run iperf3-srv_10.42.42.10(pid=23878): Launched 10:06:32.376470 tst iperf3m4.py:8: start network... 10:06:32.596680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:33.104837 run create_hlr_db(pid=23879): Launched 10:06:33.230529 bus /gobi_6: Setting Powered False 10:06:34.295596 run create_hlr_db(pid=23879): Terminated: ok {rc=0} 10:06:34.750042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23881): Launched 10:06:35.077619 run osmo-hlr_10.42.42.2(pid=23882): Launched 10:06:35.204592 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:35.775016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23884): Launched 10:06:36.103008 run osmo-stp_10.42.42.5(pid=23885): Launched 10:06:36.229503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:36.793643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23887): Launched 10:06:36.919411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:37.197572 run patchelf(pid=23888): Launched 10:06:37.381682 run osmo-stp_10.42.42.5(pid=23885): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23885)] 10:06:37.520621 run osmo-stp_10.42.42.5(pid=23885): stdout: | (launched: 2022-12-09_10:06:36.043075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:37.661085 run osmo-stp_10.42.42.5(pid=23885): stderr: | 20221209100636231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100636231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100636231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100636231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100636232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100636232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100636232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:37.801486 run osmo-stp_10.42.42.5(pid=23885): stdout: | (launched: 2022-12-09_10:06:36.043075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:37.936319 run osmo-stp_10.42.42.5(pid=23885): stderr: | 20221209100636231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100636231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100636231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100636231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100636232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100636232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100636232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:38.096349 run patchelf(pid=23888): Terminating (SIGINT) 10:06:38.280781 run patchelf(pid=23888): Terminated: ok {rc=0} 10:06:38.413468 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23885): Process ended prematurely: osmo-stp_10.42.42.5(pid=23885) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23885)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:06:38.423766 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:06:38.453677 run osmo-hlr_10.42.42.2(pid=23882): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23882)] 10:06:38.504715 run osmo-hlr_10.42.42.2(pid=23882): stdout: | (launched: 2022-12-09_10:06:35.017684) 10:06:38.557434 run osmo-hlr_10.42.42.2(pid=23882): stderr: | 20221209100635213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100635213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100635213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100635213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100635213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100635213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100635226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100635236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100635236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100635236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:38.610705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23871): Terminating (SIGTERM) 10:06:38.653394 run iperf3-srv_10.42.42.10(pid=23872): Terminating (SIGTERM) 10:06:38.696045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23873): Terminating (SIGTERM) 10:06:38.739022 run iperf3-srv_10.42.42.10(pid=23874): Terminating (SIGTERM) 10:06:38.782107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23875): Terminating (SIGTERM) 10:06:38.824913 run iperf3-srv_10.42.42.10(pid=23876): Terminating (SIGTERM) 10:06:38.867588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23877): Terminating (SIGTERM) 10:06:38.910368 run iperf3-srv_10.42.42.10(pid=23878): Terminating (SIGTERM) 10:06:38.953032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23881): Terminating (SIGTERM) 10:06:38.995809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23884): Terminating (SIGTERM) 10:06:39.038418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23887): Terminating (SIGTERM) 10:06:39.081316 --- ParallelTerminationStrategy: PID 23871 died... 10:06:39.101488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23871): Terminated: ok {rc=0} 10:06:39.148910 --- ParallelTerminationStrategy: PID 23872 died... 10:06:39.168664 run iperf3-srv_10.42.42.10(pid=23872): Terminated {rc=256} 10:06:39.215862 --- ParallelTerminationStrategy: PID 23873 died... 10:06:39.235722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23873): Terminated: ok {rc=0} 10:06:39.283555 --- ParallelTerminationStrategy: PID 23874 died... 10:06:39.303476 run iperf3-srv_10.42.42.10(pid=23874): Terminated {rc=256} 10:06:39.350462 --- ParallelTerminationStrategy: PID 23875 died... 10:06:39.370102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23875): Terminated: ok {rc=0} 10:06:39.417312 --- ParallelTerminationStrategy: PID 23876 died... 10:06:39.437209 run iperf3-srv_10.42.42.10(pid=23876): Terminated {rc=256} 10:06:39.484469 --- ParallelTerminationStrategy: PID 23877 died... 10:06:39.504310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23877): Terminated: ok {rc=0} 10:06:39.551606 --- ParallelTerminationStrategy: PID 23878 died... 10:06:39.571445 run iperf3-srv_10.42.42.10(pid=23878): Terminated {rc=256} 10:06:39.618588 --- ParallelTerminationStrategy: PID 23881 died... 10:06:39.638522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23881): Terminated: ok {rc=0} 10:06:39.686165 --- ParallelTerminationStrategy: PID 23884 died... 10:06:39.706206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23884): Terminated: ok {rc=0} 10:06:39.753805 --- ParallelTerminationStrategy: PID 23887 died... 10:06:39.773764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23887): Terminated: ok {rc=0} 10:06:39.863417 bus /gobi_4: Setting Powered False 10:06:40.966033 bus /gobi_4: Setting Powered False 10:06:42.084248 bus /gobi_1: Setting Powered False 10:06:43.184158 bus /gobi_1: Setting Powered False 10:06:44.301786 bus /gobi_0: Setting Powered False 10:06:45.400352 bus /gobi_0: Setting Powered False 10:06:46.525660 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:06:47.633029 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:47.644754 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:06:47.702782 tst ping.py: using LAC 20717 10:06:47.830294 tst ping.py: using RAC 62 10:06:47.958338 tst ping.py: using CellId 20717 10:06:48.090512 tst ping.py: using BVCI 20718 10:06:48.208346 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.219695 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.230812 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.242180 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.253843 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.265708 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.277144 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:48.288419 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:48.408881 tst ping.py:19: start network... 10:06:48.624065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:49.121245 run create_hlr_db(pid=23889): Launched 10:06:49.246101 bus /gobi_6: Setting Powered False 10:06:50.309266 run create_hlr_db(pid=23889): Terminated: ok {rc=0} 10:06:50.739349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23891): Launched 10:06:51.039089 run osmo-hlr_10.42.42.2(pid=23892): Launched 10:06:51.153175 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:51.670851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23894): Launched 10:06:51.972260 run osmo-stp_10.42.42.5(pid=23895): Launched 10:06:52.087116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:52.602970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23897): Launched 10:06:52.717398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:52.970835 run patchelf(pid=23898): Launched 10:06:53.137653 run osmo-stp_10.42.42.5(pid=23895): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23895)] 10:06:53.265428 run osmo-stp_10.42.42.5(pid=23895): stdout: | (launched: 2022-12-09_10:06:51.916538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:53.394350 run osmo-stp_10.42.42.5(pid=23895): stderr: | 20221209100652087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100652087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100652088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100652088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100652089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100652089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100652089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:53.523359 run osmo-stp_10.42.42.5(pid=23895): stdout: | (launched: 2022-12-09_10:06:51.916538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:53.646893 run osmo-stp_10.42.42.5(pid=23895): stderr: | 20221209100652087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100652087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100652088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100652088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100652089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100652089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100652089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:53.792876 run patchelf(pid=23898): Terminating (SIGINT) 10:06:53.961169 run patchelf(pid=23898): Terminated: ok {rc=0} 10:06:54.083153 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23895): Process ended prematurely: osmo-stp_10.42.42.5(pid=23895) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23895)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 10:06:54.092389 tst ping.py:22: Test FAILED (6.5 sec) 10:06:54.119352 run osmo-hlr_10.42.42.2(pid=23892): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23892)] 10:06:54.167234 run osmo-hlr_10.42.42.2(pid=23892): stdout: | (launched: 2022-12-09_10:06:50.983721) 10:06:54.217256 run osmo-hlr_10.42.42.2(pid=23892): stderr: | 20221209100651159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100651159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100651159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100651159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100651159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100651159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100651172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100651182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100651182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100651182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:54.268088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23891): Terminating (SIGTERM) 10:06:54.308353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23894): Terminating (SIGTERM) 10:06:54.348496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23897): Terminating (SIGTERM) 10:06:54.388873 --- ParallelTerminationStrategy: PID 23891 died... 10:06:54.408164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23891): Terminated: ok {rc=0} 10:06:54.453229 --- ParallelTerminationStrategy: PID 23894 died... 10:06:54.472114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23894): Terminated: ok {rc=0} 10:06:54.516913 --- ParallelTerminationStrategy: PID 23897 died... 10:06:54.536090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23897): Terminated: ok {rc=0} 10:06:54.620123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:06:55.707883 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:55.719955 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:06:55.779266 tst ping_idle_ping.py: using LAC 20718 10:06:55.910339 tst ping_idle_ping.py: using RAC 63 10:06:56.036095 tst ping_idle_ping.py: using CellId 20718 10:06:56.162029 tst ping_idle_ping.py: using BVCI 20719 10:06:56.281531 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.293138 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.304325 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.315834 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.327176 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.338678 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.350439 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:06:56.362275 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:06:56.482284 tst ping_idle_ping.py:24: start network... 10:06:56.697813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:57.197594 run create_hlr_db(pid=23899): Launched 10:06:57.322847 bus /gobi_6: Setting Powered False 10:06:58.387839 run create_hlr_db(pid=23899): Terminated: ok {rc=0} 10:06:58.820114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Launched 10:06:59.121366 run osmo-hlr_10.42.42.2(pid=23902): Launched 10:06:59.235679 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:59.752667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Launched 10:07:00.052905 run osmo-stp_10.42.42.5(pid=23905): Launched 10:07:00.167919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:00.684233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Launched 10:07:00.799013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:01.085769 run patchelf(pid=23908): Launched 10:07:01.274219 run osmo-stp_10.42.42.5(pid=23905): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] 10:07:01.416418 run osmo-stp_10.42.42.5(pid=23905): stdout: | (launched: 2022-12-09_10:06:59.997411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:01.559007 run osmo-stp_10.42.42.5(pid=23905): stderr: | 20221209100700166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100700166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100700166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100700167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100700167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100700167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100700167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:01.702396 run osmo-stp_10.42.42.5(pid=23905): stdout: | (launched: 2022-12-09_10:06:59.997411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:01.840143 run osmo-stp_10.42.42.5(pid=23905): stderr: | 20221209100700166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100700166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100700166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100700167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100700167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100700167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100700167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:02.002016 run patchelf(pid=23908): Terminating (SIGINT) 10:07:02.186868 run patchelf(pid=23908): Terminated: ok {rc=0} 10:07:02.318490 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23905): Process ended prematurely: osmo-stp_10.42.42.5(pid=23905) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:07:02.328594 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:07:02.357989 run osmo-hlr_10.42.42.2(pid=23902): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23902)] 10:07:02.410222 run osmo-hlr_10.42.42.2(pid=23902): stdout: | (launched: 2022-12-09_10:06:59.065860) 10:07:02.464025 run osmo-hlr_10.42.42.2(pid=23902): stderr: | 20221209100659242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100659242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100659242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100659242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100659242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100659242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100659254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100659263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100659263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100659263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:02.517770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Terminating (SIGTERM) 10:07:02.561013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Terminating (SIGTERM) 10:07:02.604492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Terminating (SIGTERM) 10:07:02.648467 --- ParallelTerminationStrategy: PID 23901 died... 10:07:02.669128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Terminated: ok {rc=0} 10:07:02.717562 --- ParallelTerminationStrategy: PID 23904 died... 10:07:02.737809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Terminated: ok {rc=0} 10:07:02.785949 --- ParallelTerminationStrategy: PID 23907 died... 10:07:02.806186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Terminated: ok {rc=0} 10:07:02.896419 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:07:04.194385 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:04.200941 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:07:04.223010 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:07:04.263222 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:07:04.351301 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:07:04.372333 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:07:04.411627 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:07:05.006761 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:07:05.059861 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.071281 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:07:05.128925 tst cs_paging_gprs_active.py: using LAC 20719 10:07:05.258305 tst cs_paging_gprs_active.py: using RAC 64 10:07:05.386313 tst cs_paging_gprs_active.py: using CellId 20719 10:07:05.520846 tst cs_paging_gprs_active.py: using BVCI 20720 10:07:05.640500 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.651899 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.662985 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.674378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.685710 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.697091 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.709059 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.721740 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:05.732648 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:05.847978 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:05.967384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:07:06.188885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:06.518546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23912): Launched 10:07:06.802541 run iperf3-srv_10.42.42.10(pid=23913): Launched 10:07:06.926662 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:07:07.146906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:07.475956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23914): Launched 10:07:07.759496 run iperf3-srv_10.42.42.10(pid=23915): Launched 10:07:07.881917 tst cs_paging_gprs_active.py:38: start network... 10:07:08.102075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:08.610781 run create_hlr_db(pid=23916): Launched 10:07:08.736920 bus /gobi_6: Setting Powered False 10:07:09.801213 run create_hlr_db(pid=23916): Terminated: ok {rc=0} 10:07:10.239370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23918): Launched 10:07:10.546196 run osmo-hlr_10.42.42.2(pid=23919): Launched 10:07:10.664524 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:11.192337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23921): Launched 10:07:11.498572 run osmo-stp_10.42.42.5(pid=23922): Launched 10:07:11.615287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:12.143201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23924): Launched 10:07:12.260493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:12.520107 run patchelf(pid=23925): Launched 10:07:12.689773 run osmo-stp_10.42.42.5(pid=23922): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23922)] 10:07:12.819120 run osmo-stp_10.42.42.5(pid=23922): stdout: | (launched: 2022-12-09_10:07:11.441811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:12.949789 run osmo-stp_10.42.42.5(pid=23922): stderr: | 20221209100711612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100711612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100711612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100711613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100711613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100711613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100711613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:13.080677 run osmo-stp_10.42.42.5(pid=23922): stdout: | (launched: 2022-12-09_10:07:11.441811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:13.206290 run osmo-stp_10.42.42.5(pid=23922): stderr: | 20221209100711612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100711612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100711612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100711613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100711613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100711613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100711613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:13.354980 run patchelf(pid=23925): Terminating (SIGINT) 10:07:13.525915 run patchelf(pid=23925): Terminated: ok {rc=0} 10:07:13.649393 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23922): Process ended prematurely: osmo-stp_10.42.42.5(pid=23922) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23922)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:07:13.658943 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:07:13.685995 run osmo-hlr_10.42.42.2(pid=23919): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23919)] 10:07:13.734185 run osmo-hlr_10.42.42.2(pid=23919): stdout: | (launched: 2022-12-09_10:07:10.489272) 10:07:13.783770 run osmo-hlr_10.42.42.2(pid=23919): stderr: | 20221209100710668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100710668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100710668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100710668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100710668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100710668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100710680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100710689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100710689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100710690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:13.834008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23912): Terminating (SIGTERM) 10:07:13.874348 run iperf3-srv_10.42.42.10(pid=23913): Terminating (SIGTERM) 10:07:13.914496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23914): Terminating (SIGTERM) 10:07:13.954768 run iperf3-srv_10.42.42.10(pid=23915): Terminating (SIGTERM) 10:07:13.994977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23918): Terminating (SIGTERM) 10:07:14.035140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23921): Terminating (SIGTERM) 10:07:14.075390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23924): Terminating (SIGTERM) 10:07:14.115742 --- ParallelTerminationStrategy: PID 23912 died... 10:07:14.134937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23912): Terminated: ok {rc=0} 10:07:14.179092 --- ParallelTerminationStrategy: PID 23913 died... 10:07:14.197771 run iperf3-srv_10.42.42.10(pid=23913): Terminated {rc=256} 10:07:14.242263 --- ParallelTerminationStrategy: PID 23914 died... 10:07:14.261007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23914): Terminated: ok {rc=0} 10:07:14.304817 --- ParallelTerminationStrategy: PID 23915 died... 10:07:14.323889 run iperf3-srv_10.42.42.10(pid=23915): Terminated {rc=256} 10:07:14.367817 --- ParallelTerminationStrategy: PID 23918 died... 10:07:14.386539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23918): Terminated: ok {rc=0} 10:07:14.430552 --- ParallelTerminationStrategy: PID 23921 died... 10:07:14.449401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23921): Terminated: ok {rc=0} 10:07:14.493416 --- ParallelTerminationStrategy: PID 23924 died... 10:07:14.512162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23924): Terminated: ok {rc=0} 10:07:14.596502 bus /gobi_0: Setting Powered False 10:07:15.694766 bus /gobi_0: Setting Powered False 10:07:16.809428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:07:17.957576 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:17.968890 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:07:18.033820 tst iperf3.py: using LAC 20720 10:07:18.162114 tst iperf3.py: using RAC 65 10:07:18.289209 tst iperf3.py: using CellId 20720 10:07:18.415218 tst iperf3.py: using BVCI 20721 10:07:18.535655 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.547216 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.558528 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.569874 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.580929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.592244 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.603672 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.615135 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:18.626936 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:18.745411 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:07:18.964754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:19.292625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23926): Launched 10:07:19.576822 run iperf3-srv_10.42.42.10(pid=23927): Launched 10:07:19.699247 tst iperf3.py:8: start network... 10:07:19.918387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:20.426222 run create_hlr_db(pid=23928): Launched 10:07:20.551842 bus /gobi_6: Setting Powered False 10:07:21.615806 run create_hlr_db(pid=23928): Terminated: ok {rc=0} 10:07:22.051830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23930): Launched 10:07:22.358032 run osmo-hlr_10.42.42.2(pid=23931): Launched 10:07:22.474384 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:23.005589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23933): Launched 10:07:23.311114 run osmo-stp_10.42.42.5(pid=23934): Launched 10:07:23.427407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:23.953009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23936): Launched 10:07:24.068624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:24.326465 run patchelf(pid=23937): Launched 10:07:24.496037 run osmo-stp_10.42.42.5(pid=23934): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23934)] 10:07:24.625537 run osmo-stp_10.42.42.5(pid=23934): stdout: | (launched: 2022-12-09_10:07:23.254696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:24.755698 run osmo-stp_10.42.42.5(pid=23934): stderr: | 20221209100723425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100723425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100723425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100723426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100723426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100723426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100723426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:24.886553 run osmo-stp_10.42.42.5(pid=23934): stdout: | (launched: 2022-12-09_10:07:23.254696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:25.012450 run osmo-stp_10.42.42.5(pid=23934): stderr: | 20221209100723425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100723425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100723425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100723426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100723426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100723426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100723426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:25.160643 run patchelf(pid=23937): Terminating (SIGINT) 10:07:25.331387 run patchelf(pid=23937): Terminated: ok {rc=0} 10:07:25.454683 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23934): Process ended prematurely: osmo-stp_10.42.42.5(pid=23934) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23934)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 10:07:25.464453 tst iperf3.py:8: Test FAILED (7.5 sec) 10:07:25.491791 run osmo-hlr_10.42.42.2(pid=23931): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23931)] 10:07:25.540002 run osmo-hlr_10.42.42.2(pid=23931): stdout: | (launched: 2022-12-09_10:07:22.301572) 10:07:25.590024 run osmo-hlr_10.42.42.2(pid=23931): stderr: | 20221209100722480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100722480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100722480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100722480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100722480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100722480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100722492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100722501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100722501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100722501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:25.640618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23926): Terminating (SIGTERM) 10:07:25.681084 run iperf3-srv_10.42.42.10(pid=23927): Terminating (SIGTERM) 10:07:25.721423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23930): Terminating (SIGTERM) 10:07:25.761891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23933): Terminating (SIGTERM) 10:07:25.802384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23936): Terminating (SIGTERM) 10:07:25.842925 --- ParallelTerminationStrategy: PID 23926 died... 10:07:25.862173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23926): Terminated: ok {rc=0} 10:07:25.906667 --- ParallelTerminationStrategy: PID 23927 died... 10:07:25.925532 run iperf3-srv_10.42.42.10(pid=23927): Terminated {rc=256} 10:07:25.969710 --- ParallelTerminationStrategy: PID 23930 died... 10:07:25.988541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23930): Terminated: ok {rc=0} 10:07:26.032804 --- ParallelTerminationStrategy: PID 23933 died... 10:07:26.051569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23933): Terminated: ok {rc=0} 10:07:26.095727 --- ParallelTerminationStrategy: PID 23936 died... 10:07:26.114531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23936): Terminated: ok {rc=0} 10:07:26.199265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:07:27.342917 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.354338 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:07:27.412002 tst iperf3m4.py: using LAC 20721 10:07:27.532787 tst iperf3m4.py: using RAC 66 10:07:27.651721 tst iperf3m4.py: using CellId 20721 10:07:27.775533 tst iperf3m4.py: using BVCI 20722 10:07:27.887578 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.898541 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.909139 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.919695 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.930209 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.940769 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.951523 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.962070 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:27.972708 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:28.092007 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:28.212099 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:28.330014 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:28.445980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:07:28.648432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:28.954017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23938): Launched 10:07:29.222185 run iperf3-srv_10.42.42.10(pid=23939): Launched 10:07:29.338057 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:07:29.540563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:29.846193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23940): Launched 10:07:30.113497 run iperf3-srv_10.42.42.10(pid=23941): Launched 10:07:30.227973 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:07:30.433215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:30.740640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23942): Launched 10:07:31.026130 run iperf3-srv_10.42.42.10(pid=23943): Launched 10:07:31.165942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:07:31.393370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:31.733719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23944): Launched 10:07:32.025725 run iperf3-srv_10.42.42.10(pid=23945): Launched 10:07:32.157289 tst iperf3m4.py:8: start network... 10:07:32.383007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:32.894381 run create_hlr_db(pid=23946): Launched 10:07:33.020516 bus /gobi_6: Setting Powered False 10:07:34.085208 run create_hlr_db(pid=23946): Terminated: ok {rc=0} 10:07:34.522809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23948): Launched 10:07:34.831504 run osmo-hlr_10.42.42.2(pid=23949): Launched 10:07:34.946703 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:35.491473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23951): Launched 10:07:35.797304 run osmo-stp_10.42.42.5(pid=23952): Launched 10:07:35.914148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:36.441496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23954): Launched 10:07:36.557599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:36.818814 run patchelf(pid=23955): Launched 10:07:36.987829 run osmo-stp_10.42.42.5(pid=23952): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23952)] 10:07:37.116362 run osmo-stp_10.42.42.5(pid=23952): stdout: | (launched: 2022-12-09_10:07:35.739060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:37.246409 run osmo-stp_10.42.42.5(pid=23952): stderr: | 20221209100735912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100735912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100735912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100735913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100735913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100735913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100735913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:37.376295 run osmo-stp_10.42.42.5(pid=23952): stdout: | (launched: 2022-12-09_10:07:35.739060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:37.500834 run osmo-stp_10.42.42.5(pid=23952): stderr: | 20221209100735912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100735912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100735912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100735913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100735913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100735913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100735913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:37.648785 run patchelf(pid=23955): Terminating (SIGINT) 10:07:37.819126 run patchelf(pid=23955): Terminated: ok {rc=0} 10:07:37.941872 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23952): Process ended prematurely: osmo-stp_10.42.42.5(pid=23952) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23952)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:07:37.951425 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:07:37.979115 run osmo-hlr_10.42.42.2(pid=23949): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23949)] 10:07:38.027595 run osmo-hlr_10.42.42.2(pid=23949): stdout: | (launched: 2022-12-09_10:07:34.774640) 10:07:38.077593 run osmo-hlr_10.42.42.2(pid=23949): stderr: | 20221209100734949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100734949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100734949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100734950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100734950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100734950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100734962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100734973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100734973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100734973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:38.128058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23938): Terminating (SIGTERM) 10:07:38.168636 run iperf3-srv_10.42.42.10(pid=23939): Terminating (SIGTERM) 10:07:38.208573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23940): Terminating (SIGTERM) 10:07:38.248591 run iperf3-srv_10.42.42.10(pid=23941): Terminating (SIGTERM) 10:07:38.288671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23942): Terminating (SIGTERM) 10:07:38.328769 run iperf3-srv_10.42.42.10(pid=23943): Terminating (SIGTERM) 10:07:38.368720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23944): Terminating (SIGTERM) 10:07:38.408637 run iperf3-srv_10.42.42.10(pid=23945): Terminating (SIGTERM) 10:07:38.449231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23948): Terminating (SIGTERM) 10:07:38.489304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23951): Terminating (SIGTERM) 10:07:38.529193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23954): Terminating (SIGTERM) 10:07:38.569925 --- ParallelTerminationStrategy: PID 23938 died... 10:07:38.589062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23938): Terminated: ok {rc=0} 10:07:38.633447 --- ParallelTerminationStrategy: PID 23939 died... 10:07:38.651928 run iperf3-srv_10.42.42.10(pid=23939): Terminated {rc=256} 10:07:38.695914 --- ParallelTerminationStrategy: PID 23940 died... 10:07:38.714598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23940): Terminated: ok {rc=0} 10:07:38.758592 --- ParallelTerminationStrategy: PID 23941 died... 10:07:38.777182 run iperf3-srv_10.42.42.10(pid=23941): Terminated {rc=256} 10:07:38.821397 --- ParallelTerminationStrategy: PID 23942 died... 10:07:38.839983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23942): Terminated: ok {rc=0} 10:07:38.884040 --- ParallelTerminationStrategy: PID 23943 died... 10:07:38.902695 run iperf3-srv_10.42.42.10(pid=23943): Terminated {rc=256} 10:07:38.946603 --- ParallelTerminationStrategy: PID 23944 died... 10:07:38.965296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23944): Terminated: ok {rc=0} 10:07:39.009213 --- ParallelTerminationStrategy: PID 23945 died... 10:07:39.027764 run iperf3-srv_10.42.42.10(pid=23945): Terminated {rc=256} 10:07:39.071796 --- ParallelTerminationStrategy: PID 23948 died... 10:07:39.090585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23948): Terminated: ok {rc=0} 10:07:39.134698 --- ParallelTerminationStrategy: PID 23951 died... 10:07:39.153368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23951): Terminated: ok {rc=0} 10:07:39.197258 --- ParallelTerminationStrategy: PID 23954 died... 10:07:39.215716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23954): Terminated: ok {rc=0} 10:07:39.302571 bus /gobi_4: Setting Powered False 10:07:40.403522 bus /gobi_4: Setting Powered False 10:07:41.521223 bus /gobi_1: Setting Powered False 10:07:42.620879 bus /gobi_1: Setting Powered False 10:07:43.736690 bus /gobi_0: Setting Powered False 10:07:44.841873 bus /gobi_0: Setting Powered False 10:07:45.961323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:07:47.063322 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.075704 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:07:47.134308 tst ping.py: using LAC 20722 10:07:47.264472 tst ping.py: using RAC 67 10:07:47.391240 tst ping.py: using CellId 20722 10:07:47.517931 tst ping.py: using BVCI 20723 10:07:47.637174 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.648560 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.659744 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.671107 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.682424 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.693677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.705182 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:47.716391 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:47.837562 tst ping.py:19: start network... 10:07:48.052031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:48.548091 run create_hlr_db(pid=23956): Launched 10:07:48.670037 bus /gobi_6: Setting Powered False 10:07:49.732494 run create_hlr_db(pid=23956): Terminated: ok {rc=0} 10:07:50.162126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23958): Launched 10:07:50.461221 run osmo-hlr_10.42.42.2(pid=23959): Launched 10:07:50.577114 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:51.110983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23961): Launched 10:07:51.410377 run osmo-stp_10.42.42.5(pid=23962): Launched 10:07:51.523648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:52.039903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23964): Launched 10:07:52.153920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:52.406718 run patchelf(pid=23965): Launched 10:07:52.573889 run osmo-stp_10.42.42.5(pid=23962): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23962)] 10:07:52.701085 run osmo-stp_10.42.42.5(pid=23962): stdout: | (launched: 2022-12-09_10:07:51.354933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:52.829427 run osmo-stp_10.42.42.5(pid=23962): stderr: | 20221209100751527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100751527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100751527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100751527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100751528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100751528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100751528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:52.957780 run osmo-stp_10.42.42.5(pid=23962): stdout: | (launched: 2022-12-09_10:07:51.354933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:53.080941 run osmo-stp_10.42.42.5(pid=23962): stderr: | 20221209100751527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100751527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100751527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100751527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100751528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100751528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100751528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:53.226375 run patchelf(pid=23965): Terminating (SIGINT) 10:07:53.393323 run patchelf(pid=23965): Terminated: ok {rc=0} 10:07:53.513776 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23962): Process ended prematurely: osmo-stp_10.42.42.5(pid=23962) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23962)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 10:07:53.522833 tst ping.py:22: Test FAILED (6.5 sec) 10:07:53.549648 run osmo-hlr_10.42.42.2(pid=23959): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23959)] 10:07:53.598089 run osmo-hlr_10.42.42.2(pid=23959): stdout: | (launched: 2022-12-09_10:07:50.405755) 10:07:53.648219 run osmo-hlr_10.42.42.2(pid=23959): stderr: | 20221209100750580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100750581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100750581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100750581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100750581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100750581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100750592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100750600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100750601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100750601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:53.698708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23958): Terminating (SIGTERM) 10:07:53.739002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23961): Terminating (SIGTERM) 10:07:53.779291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23964): Terminating (SIGTERM) 10:07:53.819803 --- ParallelTerminationStrategy: PID 23958 died... 10:07:53.839094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23958): Terminated: ok {rc=0} 10:07:53.883554 --- ParallelTerminationStrategy: PID 23961 died... 10:07:53.902383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23961): Terminated: ok {rc=0} 10:07:53.946635 --- ParallelTerminationStrategy: PID 23964 died... 10:07:53.965394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23964): Terminated: ok {rc=0} 10:07:54.050178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:07:55.139469 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.151995 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:07:55.215004 tst ping_idle_ping.py: using LAC 20723 10:07:55.340210 tst ping_idle_ping.py: using RAC 68 10:07:55.468531 tst ping_idle_ping.py: using CellId 20723 10:07:55.596334 tst ping_idle_ping.py: using BVCI 20724 10:07:55.707835 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.718838 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.729648 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.740420 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.751164 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.761911 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.772568 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:07:55.783172 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:07:55.900660 tst ping_idle_ping.py:24: start network... 10:07:56.116209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:56.622195 run create_hlr_db(pid=23966): Launched 10:07:56.751324 bus /gobi_6: Setting Powered False 10:07:57.815113 run create_hlr_db(pid=23966): Terminated: ok {rc=0} 10:07:58.245567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23968): Launched 10:07:58.549740 run osmo-hlr_10.42.42.2(pid=23969): Launched 10:07:58.667577 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:59.185919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23971): Launched 10:07:59.510326 run osmo-stp_10.42.42.5(pid=23972): Launched 10:07:59.635247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:00.191372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23974): Launched 10:08:00.315422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:00.587287 run patchelf(pid=23975): Launched 10:08:00.767266 run osmo-stp_10.42.42.5(pid=23972): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23972)] 10:08:00.927235 run osmo-stp_10.42.42.5(pid=23972): stdout: | (launched: 2022-12-09_10:07:59.451273) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:01.080428 run osmo-stp_10.42.42.5(pid=23972): stderr: | 20221209100759643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100759643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100759643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100759644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100759644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100759644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100759644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:01.221518 run osmo-stp_10.42.42.5(pid=23972): stdout: | (launched: 2022-12-09_10:07:59.451273) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:01.358194 run osmo-stp_10.42.42.5(pid=23972): stderr: | 20221209100759643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100759643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100759643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100759644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100759644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100759644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100759644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:01.518159 run patchelf(pid=23975): Terminating (SIGINT) 10:08:01.713616 run patchelf(pid=23975): Terminated: ok {rc=0} 10:08:01.860220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23972): Process ended prematurely: osmo-stp_10.42.42.5(pid=23972) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23972)] [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:08:01.871484 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:08:01.910629 run osmo-hlr_10.42.42.2(pid=23969): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23969)] 10:08:01.973672 run osmo-hlr_10.42.42.2(pid=23969): stdout: | (launched: 2022-12-09_10:07:58.493828) 10:08:02.036817 run osmo-hlr_10.42.42.2(pid=23969): stderr: | 20221209100758670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100758670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100758670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100758671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100758671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100758671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100758683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100758692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100758692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100758692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:02.104536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23968): Terminating (SIGTERM) 10:08:02.157862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23971): Terminating (SIGTERM) 10:08:02.204283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23974): Terminating (SIGTERM) 10:08:02.250929 --- ParallelTerminationStrategy: PID 23968 died... 10:08:02.271724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23968): Terminated: ok {rc=0} 10:08:02.321373 --- ParallelTerminationStrategy: PID 23971 died... 10:08:02.342076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23971): Terminated: ok {rc=0} 10:08:02.392214 --- ParallelTerminationStrategy: PID 23974 died... 10:08:02.412819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23974): Terminated: ok {rc=0} 10:08:02.514806 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:08:03.876632 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:03.884113 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:08:03.905625 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:08:03.940595 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:08:03.993269 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:08:04.015277 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:08:04.050048 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:08:04.606270 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:08:04.613951 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:04.626511 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:08:04.683793 tst switch_tch_pdch.py: using LAC 20724 10:08:04.804720 tst switch_tch_pdch.py: using RAC 69 10:08:04.926557 tst switch_tch_pdch.py: using CellId 20724 10:08:05.049625 tst switch_tch_pdch.py: using BVCI 20725 10:08:05.162117 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.174244 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.186093 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.198556 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.210578 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.224050 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.237148 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:08:05.249824 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:08:05.368056 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:08:05.486321 tst switch_tch_pdch.py:51: start network... 10:08:05.693366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:06.168738 run create_hlr_db(pid=24251): Launched 10:08:06.307617 bus /gobi_6: Setting Powered False 10:08:07.371655 run create_hlr_db(pid=24251): Terminated: ok {rc=0} 10:08:07.829187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24253): Launched 10:08:08.164673 run osmo-hlr_10.42.42.2(pid=24254): Launched 10:08:08.391748 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:09.089075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24256): Launched 10:08:09.406135 run osmo-stp_10.42.42.5(pid=24257): Launched 10:08:09.635618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:10.311350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24259): Launched 10:08:10.449325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:10.729717 run patchelf(pid=24260): Launched 10:08:10.929121 run osmo-stp_10.42.42.5(pid=24257): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24257)] 10:08:11.072552 run osmo-stp_10.42.42.5(pid=24257): stdout: | (launched: 2022-12-09_10:08:09.349609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:11.215549 run osmo-stp_10.42.42.5(pid=24257): stderr: | 20221209100809671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100809672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100809672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100809672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100809673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100809673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100809673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:11.360111 run osmo-stp_10.42.42.5(pid=24257): stdout: | (launched: 2022-12-09_10:08:09.349609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:11.497351 run osmo-stp_10.42.42.5(pid=24257): stderr: | 20221209100809671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100809672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100809672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100809672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100809673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100809673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100809673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:11.661436 run patchelf(pid=24260): Terminating (SIGINT) 10:08:11.847501 run patchelf(pid=24260): Terminated: ok {rc=0} 10:08:11.982410 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24257): Process ended prematurely: osmo-stp_10.42.42.5(pid=24257) [trial-2358↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24257)] [trial-2358↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:08:11.993469 tst switch_tch_pdch.py:54: Test FAILED (7.4 sec) 10:08:12.026548 run osmo-hlr_10.42.42.2(pid=24254): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24254)] 10:08:12.081168 run osmo-hlr_10.42.42.2(pid=24254): stdout: | (launched: 2022-12-09_10:08:08.105870) 10:08:12.136819 run osmo-hlr_10.42.42.2(pid=24254): stderr: | 20221209100808436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100808436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100808436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100808436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100808436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100808439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100808458 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100808470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100808471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100808471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:12.193045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24253): Terminating (SIGTERM) 10:08:12.239860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24256): Terminating (SIGTERM) 10:08:12.287365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24259): Terminating (SIGTERM) 10:08:12.334997 --- ParallelTerminationStrategy: PID 24253 died... 10:08:12.356542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24253): Terminated: ok {rc=0} 10:08:12.408364 --- ParallelTerminationStrategy: PID 24256 died... 10:08:12.430252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24256): Terminated: ok {rc=0} 10:08:12.480340 --- ParallelTerminationStrategy: PID 24259 died... 10:08:12.501888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24259): Terminated: ok {rc=0} 10:08:12.596685 bus /gobi_0: Setting Powered False 10:08:13.703039 bus /gobi_0: Setting Powered False 10:08:14.827538 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:08:16.119584 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:16.126776 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:08:16.168236 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:08:16.214664 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:08:16.273868 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:08:16.314298 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:08:16.374701 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:08:16.940050 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:08:16.945268 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:16.960558 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:08:17.022576 tst switch_tch_pdch.py: using LAC 20725 10:08:17.145734 tst switch_tch_pdch.py: using RAC 70 10:08:17.296238 tst switch_tch_pdch.py: using CellId 20725 10:08:17.467222 tst switch_tch_pdch.py: using BVCI 20726 10:08:17.589914 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.601971 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.614966 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.627842 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.641785 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.654804 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.667912 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:08:17.681789 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:08:17.809441 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:08:17.966472 tst switch_tch_pdch.py:51: start network... 10:08:18.216269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:18.707253 run create_hlr_db(pid=24265): Launched 10:08:18.873320 bus /gobi_6: Setting Powered False 10:08:19.938358 run create_hlr_db(pid=24265): Terminated: ok {rc=0} 10:08:20.375752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24267): Launched 10:08:20.719830 run osmo-hlr_10.42.42.2(pid=24268): Launched 10:08:20.971818 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:21.608796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24270): Launched 10:08:21.952508 run osmo-stp_10.42.42.5(pid=24271): Launched 10:08:22.198349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:22.820661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24273): Launched 10:08:22.957874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:23.238585 run patchelf(pid=24274): Launched 10:08:23.437608 run osmo-stp_10.42.42.5(pid=24271): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24271)] 10:08:23.580264 run osmo-stp_10.42.42.5(pid=24271): stdout: | (launched: 2022-12-09_10:08:21.892759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:23.730644 run osmo-stp_10.42.42.5(pid=24271): stderr: | 20221209100822183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100822183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100822183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100822183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100822184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100822184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100822184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:23.875344 run osmo-stp_10.42.42.5(pid=24271): stdout: | (launched: 2022-12-09_10:08:21.892759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:24.013631 run osmo-stp_10.42.42.5(pid=24271): stderr: | 20221209100822183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100822183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100822183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100822183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100822184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100822184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100822184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:24.176483 run patchelf(pid=24274): Terminating (SIGINT) 10:08:24.366457 run patchelf(pid=24274): Terminated: ok {rc=0} 10:08:24.496624 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24271): Process ended prematurely: osmo-stp_10.42.42.5(pid=24271) [trial-2358↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24271)] [trial-2358↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:08:24.506643 tst switch_tch_pdch.py:54: Test FAILED (7.6 sec) 10:08:24.535797 run osmo-hlr_10.42.42.2(pid=24268): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24268)] 10:08:24.587147 run osmo-hlr_10.42.42.2(pid=24268): stdout: | (launched: 2022-12-09_10:08:20.659227) 10:08:24.640310 run osmo-hlr_10.42.42.2(pid=24268): stderr: | 20221209100820967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100820967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100820967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100820967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100820967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100820967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100820987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100821002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100821002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100821002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:24.693827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24267): Terminating (SIGTERM) 10:08:24.737044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24270): Terminating (SIGTERM) 10:08:24.779798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24273): Terminating (SIGTERM) 10:08:24.822827 --- ParallelTerminationStrategy: PID 24267 died... 10:08:24.842573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24267): Terminated: ok {rc=0} 10:08:24.889695 --- ParallelTerminationStrategy: PID 24270 died... 10:08:24.909321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24270): Terminated: ok {rc=0} 10:08:24.956700 --- ParallelTerminationStrategy: PID 24273 died... 10:08:24.976522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24273): Terminated: ok {rc=0} 10:08:25.065742 bus /gobi_0: Setting Powered False 10:08:26.165567 bus /gobi_0: Setting Powered False 10:08:27.282040 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:trx-b200 --------------------------------------------------------------------- 10:08:28.519387 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:28.523214 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:08:28.556246 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:08:28.562984 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:08:28.614529 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:08:28.647183 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:08:28.653758 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:08:29.193437 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:08:29.198344 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 10:08:29.208920 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 10:08:29.257360 tst mo_mt_sms.py: using LAC 20726 10:08:29.375621 tst mo_mt_sms.py: using RAC 71 10:08:29.494039 tst mo_mt_sms.py: using CellId 20726 10:08:29.610829 tst mo_mt_sms.py: using BVCI 20727 10:08:29.720597 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:08:29.839162 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:08:29.957182 tst mo_mt_sms.py:9: start nitb and bts... 10:08:30.173292 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:08:30.840658 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24280): Launched 10:08:31.186628 run osmo-nitb_10.42.42.2(pid=24281): Launched 10:08:31.422352 run osmo-nitb_10.42.42.2(pid=24281): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24281)] 10:08:31.572272 run osmo-nitb_10.42.42.2(pid=24281): stdout: | (launched: 2022-12-09_10:08:31.127498) 10:08:31.721657 run osmo-nitb_10.42.42.2(pid=24281): stderr: | (launched: 2022-12-09_10:08:31.176325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:08:31.871610 run osmo-nitb_10.42.42.2(pid=24281): stdout: | (launched: 2022-12-09_10:08:31.127498) 10:08:32.052183 run osmo-nitb_10.42.42.2(pid=24281): stderr: | (launched: 2022-12-09_10:08:31.176325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24281): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24281) [trial-2358↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24281)] 10:08:32.363575 tst osmo-nitb_10.42.42.2(pid=24281): stdout: | (launched: 2022-12-09_10:08:31.127498) 10:08:32.493094 tst osmo-nitb_10.42.42.2(pid=24281): stderr: | (launched: 2022-12-09_10:08:31.176325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:08:32.645508 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24281): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24281) [trial-2358↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24281)] [trial-2358↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 10:08:32.655009 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:08:32.662534 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24280): Terminating (SIGTERM) 10:08:32.874021 --- ParallelTerminationStrategy: PID 24280 died... 10:08:32.896258 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24280): Terminated: ok {rc=0} 10:08:32.985068 bus /sierra_3: Setting Powered False 10:08:34.085486 bus /sierra_3: Setting Powered False 10:08:35.203179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:trx-b200 --------------------------------------------------------------------- 10:08:36.403552 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:36.408070 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:08:36.443254 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:08:36.470693 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:08:36.523561 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:08:36.557402 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:08:36.584620 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:08:37.130976 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:08:37.136267 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:37.147456 tst sms:trx-b200: Using 1 x bts (candidates: 1) 10:08:37.196436 tst mo_mt_sms.py: using LAC 20727 10:08:37.327265 tst mo_mt_sms.py: using RAC 72 10:08:37.451363 tst mo_mt_sms.py: using CellId 20727 10:08:37.568718 tst mo_mt_sms.py: using BVCI 20728 10:08:37.687091 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:37.698342 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:37.709369 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:37.720558 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:37.731878 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:37.743089 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:08:37.862883 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:08:37.978770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:38.443604 run create_hlr_db(pid=24285): Launched 10:08:38.567276 bus /sierra_2: Setting Powered False 10:08:39.626626 run create_hlr_db(pid=24285): Terminated: ok {rc=0} 10:08:40.067546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24287): Launched 10:08:40.390940 run osmo-hlr_10.42.42.2(pid=24288): Launched 10:08:40.514446 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:41.068252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24290): Launched 10:08:41.388900 run osmo-stp_10.42.42.5(pid=24291): Launched 10:08:41.510718 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:42.091674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24293): Launched 10:08:42.414006 run osmo-msc_10.42.42.6(pid=24294): Launched 10:08:42.592449 run osmo-stp_10.42.42.5(pid=24291): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24291)] 10:08:42.727635 run osmo-stp_10.42.42.5(pid=24291): stdout: | (launched: 2022-12-09_10:08:41.329623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:42.863821 run osmo-stp_10.42.42.5(pid=24291): stderr: | 20221209100841522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100841522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100841522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100841523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100841523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100841523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100841523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:42.999383 run osmo-stp_10.42.42.5(pid=24291): stdout: | (launched: 2022-12-09_10:08:41.329623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:43.126877 run osmo-stp_10.42.42.5(pid=24291): stderr: | 20221209100841522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100841522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100841522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100841523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100841523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100841523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100841523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:43.279146 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24291): Process ended prematurely: osmo-stp_10.42.42.5(pid=24291) [trial-2358↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24291)] [trial-2358↪sms:trx-b200↪mo_mt_sms.py:16] 10:08:43.288313 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 10:08:43.317126 run osmo-hlr_10.42.42.2(pid=24288): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24288)] 10:08:43.368706 run osmo-hlr_10.42.42.2(pid=24288): stdout: | (launched: 2022-12-09_10:08:40.331247) 10:08:43.421982 run osmo-hlr_10.42.42.2(pid=24288): stderr: | 20221209100840529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100840529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100840529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100840529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100840530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100840530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100840542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100840552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100840552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100840552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:43.496041 run osmo-msc_10.42.42.6(pid=24294): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24294)] 10:08:43.547369 run osmo-msc_10.42.42.6(pid=24294): stdout: | (launched: 2022-12-09_10:08:42.354602) 10:08:43.600923 run osmo-msc_10.42.42.6(pid=24294): stderr: | 20221209100842678 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100842678 DLGLOBAL DEBUG validating counter group 0x7f4b4d6ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100842678 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100842678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100842678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100842679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100842680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100842681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100842681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100842681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:43.654388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24287): Terminating (SIGTERM) 10:08:43.697795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24290): Terminating (SIGTERM) 10:08:43.741070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24293): Terminating (SIGTERM) 10:08:43.784211 --- ParallelTerminationStrategy: PID 24287 died... 10:08:43.804630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24287): Terminated: ok {rc=0} 10:08:43.852157 --- ParallelTerminationStrategy: PID 24290 died... 10:08:43.872100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24290): Terminated: ok {rc=0} 10:08:43.919414 --- ParallelTerminationStrategy: PID 24293 died... 10:08:43.939385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24293): Terminated: ok {rc=0} 10:08:44.029966 bus /sierra_3: Setting Powered False 10:08:45.130164 bus /sierra_3: Setting Powered False 10:08:46.245128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-b200 --------------------------------------------------------------------- 10:08:47.471200 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:47.475210 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:08:47.507704 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:08:47.514329 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:08:47.549475 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:08:47.582177 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:08:47.588926 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:08:48.107708 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:08:48.112758 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 10:08:48.123577 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 10:08:48.175251 tst assert_extension.py: using LAC 20728 10:08:48.292282 tst assert_extension.py: using RAC 73 10:08:48.418486 tst assert_extension.py: using CellId 20728 10:08:48.542384 tst assert_extension.py: using BVCI 20729 10:08:48.659247 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 10:08:48.774394 tst assert_extension.py:10: start nitb and bts... 10:08:48.973474 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:08:49.588785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24299): Launched 10:08:49.887014 run osmo-nitb_10.42.42.2(pid=24300): Launched 10:08:50.053649 run osmo-nitb_10.42.42.2(pid=24300): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24300)] 10:08:50.187749 run osmo-nitb_10.42.42.2(pid=24300): stdout: | (launched: 2022-12-09_10:08:49.831466) 10:08:50.323358 run osmo-nitb_10.42.42.2(pid=24300): stderr: | (launched: 2022-12-09_10:08:49.876004) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:08:50.459017 run osmo-nitb_10.42.42.2(pid=24300): stdout: | (launched: 2022-12-09_10:08:49.831466) 10:08:50.589731 run osmo-nitb_10.42.42.2(pid=24300): stderr: | (launched: 2022-12-09_10:08:49.876004) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24300): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24300) [trial-2358↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24300)] 10:08:51.001685 tst osmo-nitb_10.42.42.2(pid=24300): stdout: | (launched: 2022-12-09_10:08:49.831466) 10:08:51.122816 tst osmo-nitb_10.42.42.2(pid=24300): stderr: | (launched: 2022-12-09_10:08:49.876004) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:08:51.264686 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24300): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24300) [trial-2358↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24300)] [trial-2358↪nitb_ussd:trx-b200↪assert_extension.py:12] 10:08:51.273184 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:08:51.279712 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24299): Terminating (SIGTERM) 10:08:51.490304 --- ParallelTerminationStrategy: PID 24299 died... 10:08:51.511384 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24299): Terminated: ok {rc=0} 10:08:51.599395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:trx-b200 --------------------------------------------------------------------- 10:08:52.776460 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:52.780710 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:08:52.815152 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:08:52.841597 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:08:52.876914 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:08:52.910029 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:08:52.936521 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:08:53.463953 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:08:53.469118 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:53.479722 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 10:08:53.528134 tst assert_extension.py: using LAC 20729 10:08:53.655893 tst assert_extension.py: using RAC 74 10:08:53.783581 tst assert_extension.py: using CellId 20729 10:08:53.911955 tst assert_extension.py: using BVCI 20730 10:08:54.028942 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:54.040173 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:54.051231 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:54.062482 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:54.073932 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:08:54.085270 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 10:08:54.200889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:54.667202 run create_hlr_db(pid=24304): Launched 10:08:54.790404 bus /sierra_2: Setting Powered False 10:08:55.850058 run create_hlr_db(pid=24304): Terminated: ok {rc=0} 10:08:56.268842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24307): Launched 10:08:56.568531 run osmo-hlr_10.42.42.2(pid=24308): Launched 10:08:56.683310 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:57.203091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24310): Launched 10:08:57.501524 run osmo-stp_10.42.42.5(pid=24311): Launched 10:08:57.616017 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:58.156775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24313): Launched 10:08:58.454599 run osmo-msc_10.42.42.6(pid=24314): Launched 10:08:58.621801 run osmo-stp_10.42.42.5(pid=24311): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24311)] 10:08:58.748471 run osmo-stp_10.42.42.5(pid=24311): stdout: | (launched: 2022-12-09_10:08:57.446208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:58.875472 run osmo-stp_10.42.42.5(pid=24311): stderr: | 20221209100857615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100857615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100857615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100857616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100857616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100857616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100857616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:59.000293 run osmo-stp_10.42.42.5(pid=24311): stdout: | (launched: 2022-12-09_10:08:57.446208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:59.120059 run osmo-stp_10.42.42.5(pid=24311): stderr: | 20221209100857615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100857615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100857615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100857616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100857616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100857616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100857616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:59.262944 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24311): Process ended prematurely: osmo-stp_10.42.42.5(pid=24311) [trial-2358↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24311)] [trial-2358↪ussd:trx-b200↪assert_extension.py:17] 10:08:59.271506 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:08:59.297830 run osmo-hlr_10.42.42.2(pid=24308): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24308)] 10:08:59.346429 run osmo-hlr_10.42.42.2(pid=24308): stdout: | (launched: 2022-12-09_10:08:56.512654) 10:08:59.396785 run osmo-hlr_10.42.42.2(pid=24308): stderr: | 20221209100856690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100856690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100856690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100856690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100856690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100856690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100856702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100856711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100856711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100856711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:59.466970 run osmo-msc_10.42.42.6(pid=24314): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24314)] 10:08:59.515431 run osmo-msc_10.42.42.6(pid=24314): stdout: | (launched: 2022-12-09_10:08:58.399238) 10:08:59.565479 run osmo-msc_10.42.42.6(pid=24314): stderr: | 20221209100858671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100858671 DLGLOBAL DEBUG validating counter group 0x7efd44f76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100858671 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100858671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100858672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100858673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100858674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100858675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100858675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100858675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:59.616009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24307): Terminating (SIGTERM) 10:08:59.656541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24310): Terminating (SIGTERM) 10:08:59.696897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24313): Terminating (SIGTERM) 10:08:59.737524 --- ParallelTerminationStrategy: PID 24307 died... 10:08:59.756871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24307): Terminated: ok {rc=0} 10:08:59.801681 --- ParallelTerminationStrategy: PID 24310 died... 10:08:59.820564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24310): Terminated: ok {rc=0} 10:08:59.864772 --- ParallelTerminationStrategy: PID 24313 died... 10:08:59.883649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24313): Terminated: ok {rc=0} 10:08:59.968586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:09:01.182849 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:01.190784 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:09:01.229203 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:09:01.259392 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:09:01.316065 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:09:01.381212 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:09:01.421828 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:09:01.929213 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:09:01.993462 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:02.008565 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:09:02.092307 tst mo_mt_call.py: using LAC 20730 10:09:02.223482 tst mo_mt_call.py: using RAC 75 10:09:02.353120 tst mo_mt_call.py: using CellId 20730 10:09:02.485538 tst mo_mt_call.py: using BVCI 20731 10:09:02.606280 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:02.618035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:02.629675 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:02.641973 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:02.654066 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:02.666329 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:09:02.785738 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:09:02.902943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:03.380152 run create_hlr_db(pid=24319): Launched 10:09:03.505577 bus /sierra_2: Setting Powered False 10:09:04.566595 run create_hlr_db(pid=24319): Terminated: ok {rc=0} 10:09:04.992739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24321): Launched 10:09:05.298061 run osmo-hlr_10.42.42.2(pid=24322): Launched 10:09:05.413871 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:05.936821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24324): Launched 10:09:06.240900 run osmo-stp_10.42.42.5(pid=24325): Launched 10:09:06.356856 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:06.907919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24327): Launched 10:09:07.212860 run osmo-msc_10.42.42.6(pid=24328): Launched 10:09:07.383603 run osmo-stp_10.42.42.5(pid=24325): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24325)] 10:09:07.511821 run osmo-stp_10.42.42.5(pid=24325): stdout: | (launched: 2022-12-09_10:09:06.184429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:07.640375 run osmo-stp_10.42.42.5(pid=24325): stderr: | 20221209100906356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100906356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100906357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100906357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100906358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100906358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100906358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:07.767481 run osmo-stp_10.42.42.5(pid=24325): stdout: | (launched: 2022-12-09_10:09:06.184429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:07.889715 run osmo-stp_10.42.42.5(pid=24325): stderr: | 20221209100906356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100906356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100906357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100906357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100906358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100906358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100906358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:08.035180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24325): Process ended prematurely: osmo-stp_10.42.42.5(pid=24325) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24325)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:09:08.044319 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:09:08.071246 run osmo-hlr_10.42.42.2(pid=24322): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24322)] 10:09:08.119959 run osmo-hlr_10.42.42.2(pid=24322): stdout: | (launched: 2022-12-09_10:09:05.242151) 10:09:08.170368 run osmo-hlr_10.42.42.2(pid=24322): stderr: | 20221209100905418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100905418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100905418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100905418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100905418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100905418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100905430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100905440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100905440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100905440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:08.240505 run osmo-msc_10.42.42.6(pid=24328): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24328)] 10:09:08.289271 run osmo-msc_10.42.42.6(pid=24328): stdout: | (launched: 2022-12-09_10:09:07.156775) 10:09:08.339538 run osmo-msc_10.42.42.6(pid=24328): stderr: | 20221209100907427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100907427 DLGLOBAL DEBUG validating counter group 0x7f5a7a5f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100907427 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100907427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100907428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100907428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100907429 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100907430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100907430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100907430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:08.390121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24321): Terminating (SIGTERM) 10:09:08.430677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24324): Terminating (SIGTERM) 10:09:08.471400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24327): Terminating (SIGTERM) 10:09:08.512045 --- ParallelTerminationStrategy: PID 24321 died... 10:09:08.531379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24321): Terminated: ok {rc=0} 10:09:08.576386 --- ParallelTerminationStrategy: PID 24324 died... 10:09:08.595345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24324): Terminated: ok {rc=0} 10:09:08.639707 --- ParallelTerminationStrategy: PID 24327 died... 10:09:08.658379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24327): Terminated: ok {rc=0} 10:09:08.743253 bus /sierra_3: Setting Powered False 10:09:09.842437 bus /sierra_3: Setting Powered False 10:09:10.962197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:09:12.112018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:12.123735 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:09:12.192710 tst mo_mt_call_osmux.py: using LAC 20731 10:09:12.313404 tst mo_mt_call_osmux.py: using RAC 76 10:09:12.442737 tst mo_mt_call_osmux.py: using CellId 20731 10:09:12.577772 tst mo_mt_call_osmux.py: using BVCI 20732 10:09:12.690122 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:12.701321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:12.712085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:12.723112 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:12.734209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:09:12.745168 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:09:12.860189 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:09:12.979295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:13.489624 run create_hlr_db(pid=24330): Launched 10:09:13.614737 bus /sierra_2: Setting Powered False 10:09:14.678083 run create_hlr_db(pid=24330): Terminated: ok {rc=0} 10:09:15.113253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24332): Launched 10:09:15.413954 run osmo-hlr_10.42.42.2(pid=24333): Launched 10:09:15.528055 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:16.097698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24335): Launched 10:09:16.462728 run osmo-stp_10.42.42.5(pid=24336): Launched 10:09:16.599824 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:17.385778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24338): Launched 10:09:17.694361 run osmo-msc_10.42.42.6(pid=24339): Launched 10:09:17.861755 run osmo-stp_10.42.42.5(pid=24336): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24336)] 10:09:17.987936 run osmo-stp_10.42.42.5(pid=24336): stdout: | (launched: 2022-12-09_10:09:16.399821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:18.114301 run osmo-stp_10.42.42.5(pid=24336): stderr: | 20221209100916795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100916795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100916798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100916801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100916802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100916802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100916802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:18.239158 run osmo-stp_10.42.42.5(pid=24336): stdout: | (launched: 2022-12-09_10:09:16.399821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:18.358737 run osmo-stp_10.42.42.5(pid=24336): stderr: | 20221209100916795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100916795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100916798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100916801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100916802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100916802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100916802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:18.501686 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24336): Process ended prematurely: osmo-stp_10.42.42.5(pid=24336) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24336)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:09:18.510499 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:09:18.536717 run osmo-hlr_10.42.42.2(pid=24333): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24333)] 10:09:18.584357 run osmo-hlr_10.42.42.2(pid=24333): stdout: | (launched: 2022-12-09_10:09:15.358318) 10:09:18.633796 run osmo-hlr_10.42.42.2(pid=24333): stderr: | 20221209100915531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100915531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100915531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100915531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100915531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100915531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100915543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100915552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100915552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100915553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:18.702719 run osmo-msc_10.42.42.6(pid=24339): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24339)] 10:09:18.750215 run osmo-msc_10.42.42.6(pid=24339): stdout: | (launched: 2022-12-09_10:09:17.639197) 10:09:18.799463 run osmo-msc_10.42.42.6(pid=24339): stderr: | 20221209100917910 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100917910 DLGLOBAL DEBUG validating counter group 0x7f2b7692ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100917910 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100917910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100917910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100917911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100917913 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100917914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100917914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100917914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:18.849196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24332): Terminating (SIGTERM) 10:09:18.888741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24335): Terminating (SIGTERM) 10:09:18.928557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24338): Terminating (SIGTERM) 10:09:18.968596 --- ParallelTerminationStrategy: PID 24332 died... 10:09:18.987721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24332): Terminated: ok {rc=0} 10:09:19.031508 --- ParallelTerminationStrategy: PID 24335 died... 10:09:19.050133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24335): Terminated: ok {rc=0} 10:09:19.093733 --- ParallelTerminationStrategy: PID 24338 died... 10:09:19.112331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24338): Terminated: ok {rc=0} 10:09:19.196340 bus /sierra_3: Setting Powered False 10:09:20.295813 bus /sierra_3: Setting Powered False 10:09:21.415982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:09:22.664031 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:22.670466 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:09:22.702799 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:09:22.729180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:09:22.779912 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:09:22.812027 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:09:22.838070 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:09:23.393457 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:09:23.446951 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:23.458541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:09:23.530249 tst mo_mt_call.py: using LAC 20732 10:09:23.650094 tst mo_mt_call.py: using RAC 77 10:09:23.768124 tst mo_mt_call.py: using CellId 20732 10:09:23.889244 tst mo_mt_call.py: using BVCI 20733 10:09:23.998955 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:24.009999 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:24.020796 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:24.031605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:24.042544 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:24.053368 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:09:24.170745 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:09:24.287084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:24.752638 run create_hlr_db(pid=24344): Launched 10:09:24.875181 bus /sierra_2: Setting Powered False 10:09:25.934364 run create_hlr_db(pid=24344): Terminated: ok {rc=0} 10:09:26.352090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24346): Launched 10:09:26.651098 run osmo-hlr_10.42.42.2(pid=24347): Launched 10:09:26.764698 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:27.278384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24349): Launched 10:09:27.577439 run osmo-stp_10.42.42.5(pid=24350): Launched 10:09:27.692382 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:28.238224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24352): Launched 10:09:28.536331 run osmo-msc_10.42.42.6(pid=24353): Launched 10:09:28.703641 run osmo-stp_10.42.42.5(pid=24350): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24350)] 10:09:28.830120 run osmo-stp_10.42.42.5(pid=24350): stdout: | (launched: 2022-12-09_10:09:27.521893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:28.956462 run osmo-stp_10.42.42.5(pid=24350): stderr: | 20221209100927691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100927691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100927691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100927692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100927692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100927692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100927692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:29.080679 run osmo-stp_10.42.42.5(pid=24350): stdout: | (launched: 2022-12-09_10:09:27.521893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:29.199878 run osmo-stp_10.42.42.5(pid=24350): stderr: | 20221209100927691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100927691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100927691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100927692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100927692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100927692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100927692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:29.343309 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24350): Process ended prematurely: osmo-stp_10.42.42.5(pid=24350) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24350)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:09:29.352154 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 10:09:29.378417 run osmo-hlr_10.42.42.2(pid=24347): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24347)] 10:09:29.425683 run osmo-hlr_10.42.42.2(pid=24347): stdout: | (launched: 2022-12-09_10:09:26.595533) 10:09:29.474753 run osmo-hlr_10.42.42.2(pid=24347): stderr: | 20221209100926772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100926772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100926772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100926772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100926772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100926772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100926784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100926794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100926794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100926794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:29.542938 run osmo-msc_10.42.42.6(pid=24353): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24353)] 10:09:29.590333 run osmo-msc_10.42.42.6(pid=24353): stdout: | (launched: 2022-12-09_10:09:28.480806) 10:09:29.639150 run osmo-msc_10.42.42.6(pid=24353): stderr: | 20221209100928752 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100928753 DLGLOBAL DEBUG validating counter group 0x7f03d2a47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100928753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100928753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100928753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100928753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100928755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100928756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100928756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100928756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:29.688294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24346): Terminating (SIGTERM) 10:09:29.727644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24349): Terminating (SIGTERM) 10:09:29.766974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24352): Terminating (SIGTERM) 10:09:29.806544 --- ParallelTerminationStrategy: PID 24346 died... 10:09:29.825490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24346): Terminated: ok {rc=0} 10:09:29.869081 --- ParallelTerminationStrategy: PID 24349 died... 10:09:29.887458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24349): Terminated: ok {rc=0} 10:09:29.931309 --- ParallelTerminationStrategy: PID 24352 died... 10:09:29.949842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24352): Terminated: ok {rc=0} 10:09:30.035890 bus /sierra_3: Setting Powered False 10:09:31.137560 bus /sierra_3: Setting Powered False 10:09:32.258016 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:09:33.408822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:33.421175 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:09:33.502368 tst mo_mt_call_osmux.py: using LAC 20733 10:09:33.638790 tst mo_mt_call_osmux.py: using RAC 78 10:09:33.766826 tst mo_mt_call_osmux.py: using CellId 20733 10:09:33.893649 tst mo_mt_call_osmux.py: using BVCI 20734 10:09:34.012332 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:34.023871 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:34.035211 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:34.047009 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:34.058763 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:09:34.070336 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:09:34.188499 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:09:34.312085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:34.811834 run create_hlr_db(pid=24355): Launched 10:09:34.933421 bus /sierra_2: Setting Powered False 10:09:35.996670 run create_hlr_db(pid=24355): Terminated: ok {rc=0} 10:09:36.426182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Launched 10:09:36.725866 run osmo-hlr_10.42.42.2(pid=24358): Launched 10:09:36.839001 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:37.354209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Launched 10:09:37.654011 run osmo-stp_10.42.42.5(pid=24361): Launched 10:09:37.766176 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:38.310287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24363): Launched 10:09:38.607810 run osmo-msc_10.42.42.6(pid=24364): Launched 10:09:38.773864 run osmo-stp_10.42.42.5(pid=24361): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] 10:09:38.899686 run osmo-stp_10.42.42.5(pid=24361): stdout: | (launched: 2022-12-09_10:09:37.598213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:39.025770 run osmo-stp_10.42.42.5(pid=24361): stderr: | 20221209100937767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100937767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100937767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100937767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100937768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100937768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100937768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:39.150172 run osmo-stp_10.42.42.5(pid=24361): stdout: | (launched: 2022-12-09_10:09:37.598213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:39.269206 run osmo-stp_10.42.42.5(pid=24361): stderr: | 20221209100937767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100937767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100937767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100937767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100937768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100937768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100937768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:39.412363 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24361): Process ended prematurely: osmo-stp_10.42.42.5(pid=24361) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:09:39.421455 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:09:39.447750 run osmo-hlr_10.42.42.2(pid=24358): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24358)] 10:09:39.495323 run osmo-hlr_10.42.42.2(pid=24358): stdout: | (launched: 2022-12-09_10:09:36.670181) 10:09:39.545079 run osmo-hlr_10.42.42.2(pid=24358): stderr: | 20221209100936845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100936845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100936845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100936845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100936845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100936845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100936857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100936866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100936866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100936866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:39.613888 run osmo-msc_10.42.42.6(pid=24364): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24364)] 10:09:39.661401 run osmo-msc_10.42.42.6(pid=24364): stdout: | (launched: 2022-12-09_10:09:38.552376) 10:09:39.710472 run osmo-msc_10.42.42.6(pid=24364): stderr: | 20221209100938825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100938825 DLGLOBAL DEBUG validating counter group 0x7f0c5c712c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100938825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100938825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100938825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100938825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100938827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100938827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100938828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100938828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:39.759956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Terminating (SIGTERM) 10:09:39.799273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Terminating (SIGTERM) 10:09:39.838623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24363): Terminating (SIGTERM) 10:09:39.878199 --- ParallelTerminationStrategy: PID 24357 died... 10:09:39.897149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Terminated: ok {rc=0} 10:09:39.940650 --- ParallelTerminationStrategy: PID 24360 died... 10:09:39.959884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Terminated: ok {rc=0} 10:09:40.003462 --- ParallelTerminationStrategy: PID 24363 died... 10:09:40.022006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24363): Terminated: ok {rc=0} 10:09:40.105226 bus /sierra_3: Setting Powered False 10:09:41.202934 bus /sierra_3: Setting Powered False 10:09:42.318904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:09:43.572904 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:43.580221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:09:43.615907 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:09:43.643515 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:09:43.696152 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:09:43.730470 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:09:43.757604 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:09:44.305301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:09:44.354609 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:44.365861 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:09:44.434487 tst mo_mt_call.py: using LAC 20734 10:09:44.558047 tst mo_mt_call.py: using RAC 79 10:09:44.675703 tst mo_mt_call.py: using CellId 20734 10:09:44.795808 tst mo_mt_call.py: using BVCI 20735 10:09:44.905804 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:44.916927 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:44.927898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:44.939087 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:44.950221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:44.961431 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:09:45.079160 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:09:45.192143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:45.662184 run create_hlr_db(pid=24369): Launched 10:09:45.786900 bus /sierra_2: Setting Powered False 10:09:46.855304 run create_hlr_db(pid=24369): Terminated: ok {rc=0} 10:09:47.302976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24371): Launched 10:09:47.605361 run osmo-hlr_10.42.42.2(pid=24372): Launched 10:09:47.718272 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:48.248354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24374): Launched 10:09:48.549999 run osmo-stp_10.42.42.5(pid=24375): Launched 10:09:48.662861 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:49.206278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24377): Launched 10:09:49.508785 run osmo-msc_10.42.42.6(pid=24378): Launched 10:09:49.675652 run osmo-stp_10.42.42.5(pid=24375): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24375)] 10:09:49.801454 run osmo-stp_10.42.42.5(pid=24375): stdout: | (launched: 2022-12-09_10:09:48.491345) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:49.926761 run osmo-stp_10.42.42.5(pid=24375): stderr: | 20221209100948663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100948663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100948663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100948664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100948664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100948664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100948664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:50.050726 run osmo-stp_10.42.42.5(pid=24375): stdout: | (launched: 2022-12-09_10:09:48.491345) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:50.169522 run osmo-stp_10.42.42.5(pid=24375): stderr: | 20221209100948663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100948663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100948663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100948664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100948664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100948664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100948664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:50.311602 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24375): Process ended prematurely: osmo-stp_10.42.42.5(pid=24375) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24375)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:09:50.320656 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:09:50.347169 run osmo-hlr_10.42.42.2(pid=24372): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24372)] 10:09:50.394933 run osmo-hlr_10.42.42.2(pid=24372): stdout: | (launched: 2022-12-09_10:09:47.547524) 10:09:50.444016 run osmo-hlr_10.42.42.2(pid=24372): stderr: | 20221209100947723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100947723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100947723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100947723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100947723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100947723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100947735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100947746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100947746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100947747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:50.512331 run osmo-msc_10.42.42.6(pid=24378): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24378)] 10:09:50.559807 run osmo-msc_10.42.42.6(pid=24378): stdout: | (launched: 2022-12-09_10:09:49.448809) 10:09:50.608713 run osmo-msc_10.42.42.6(pid=24378): stderr: | 20221209100949722 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100949723 DLGLOBAL DEBUG validating counter group 0x7fa2b6d70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100949723 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100949723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100949723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100949723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100949725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100949725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100949725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100949726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:50.657936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24371): Terminating (SIGTERM) 10:09:50.697280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24374): Terminating (SIGTERM) 10:09:50.736653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24377): Terminating (SIGTERM) 10:09:50.776300 --- ParallelTerminationStrategy: PID 24371 died... 10:09:50.795328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24371): Terminated: ok {rc=0} 10:09:50.839173 --- ParallelTerminationStrategy: PID 24374 died... 10:09:50.857659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24374): Terminated: ok {rc=0} 10:09:50.901505 --- ParallelTerminationStrategy: PID 24377 died... 10:09:50.920058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24377): Terminated: ok {rc=0} 10:09:51.005264 bus /sierra_3: Setting Powered False 10:09:52.104257 bus /sierra_3: Setting Powered False 10:09:53.219246 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:09:54.365714 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:54.377494 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:09:54.445979 tst mo_mt_call_osmux.py: using LAC 20735 10:09:54.564894 tst mo_mt_call_osmux.py: using RAC 80 10:09:54.685202 tst mo_mt_call_osmux.py: using CellId 20735 10:09:54.809520 tst mo_mt_call_osmux.py: using BVCI 20736 10:09:54.917702 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:54.928519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:54.939332 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:54.950652 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:54.962129 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:09:54.973551 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:09:55.091760 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:09:55.207759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:55.674752 run create_hlr_db(pid=24380): Launched 10:09:55.796135 bus /sierra_2: Setting Powered False 10:09:56.854833 run create_hlr_db(pid=24380): Terminated: ok {rc=0} 10:09:57.270837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24382): Launched 10:09:57.571779 run osmo-hlr_10.42.42.2(pid=24383): Launched 10:09:57.683570 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:58.203593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24385): Launched 10:09:58.503681 run osmo-stp_10.42.42.5(pid=24386): Launched 10:09:58.616841 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:59.158921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24388): Launched 10:09:59.460906 run osmo-msc_10.42.42.6(pid=24389): Launched 10:09:59.628094 run osmo-stp_10.42.42.5(pid=24386): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24386)] 10:09:59.754081 run osmo-stp_10.42.42.5(pid=24386): stdout: | (launched: 2022-12-09_10:09:58.445341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:59.879936 run osmo-stp_10.42.42.5(pid=24386): stderr: | 20221209100958616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100958616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100958616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100958617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100958617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100958618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100958618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:00.003862 run osmo-stp_10.42.42.5(pid=24386): stdout: | (launched: 2022-12-09_10:09:58.445341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:00.122508 run osmo-stp_10.42.42.5(pid=24386): stderr: | 20221209100958616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209100958616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209100958616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209100958617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209100958617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209100958618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209100958618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:00.264856 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24386): Process ended prematurely: osmo-stp_10.42.42.5(pid=24386) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24386)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:10:00.273910 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 10:10:00.300374 run osmo-hlr_10.42.42.2(pid=24383): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24383)] 10:10:00.347941 run osmo-hlr_10.42.42.2(pid=24383): stdout: | (launched: 2022-12-09_10:09:57.513332) 10:10:00.397250 run osmo-hlr_10.42.42.2(pid=24383): stderr: | 20221209100957691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209100957691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209100957691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209100957691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209100957691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209100957691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209100957703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209100957712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209100957713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209100957713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:00.465661 run osmo-msc_10.42.42.6(pid=24389): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24389)] 10:10:00.513073 run osmo-msc_10.42.42.6(pid=24389): stdout: | (launched: 2022-12-09_10:09:59.401468) 10:10:00.562190 run osmo-msc_10.42.42.6(pid=24389): stderr: | 20221209100959675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209100959675 DLGLOBAL DEBUG validating counter group 0x7f288b2dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209100959675 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209100959675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209100959676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209100959676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209100959678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209100959678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209100959678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209100959678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:00.611716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24382): Terminating (SIGTERM) 10:10:00.651195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24385): Terminating (SIGTERM) 10:10:00.690772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24388): Terminating (SIGTERM) 10:10:00.730653 --- ParallelTerminationStrategy: PID 24382 died... 10:10:00.749778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24382): Terminated: ok {rc=0} 10:10:00.793778 --- ParallelTerminationStrategy: PID 24385 died... 10:10:00.812318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24385): Terminated: ok {rc=0} 10:10:00.878076 --- ParallelTerminationStrategy: PID 24388 died... 10:10:00.897270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24388): Terminated: ok {rc=0} 10:10:00.982939 bus /sierra_3: Setting Powered False 10:10:02.084861 bus /sierra_3: Setting Powered False 10:10:03.199268 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:10:04.448531 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:04.455124 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:10:04.487869 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:10:04.514017 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:10:04.566129 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:10:04.599052 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:10:04.625208 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:10:05.173499 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:10:05.221374 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:05.232531 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:10:05.300883 tst mo_mt_call.py: using LAC 20736 10:10:05.417434 tst mo_mt_call.py: using RAC 81 10:10:05.545433 tst mo_mt_call.py: using CellId 20736 10:10:05.673056 tst mo_mt_call.py: using BVCI 20737 10:10:05.791527 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:05.803184 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:05.814640 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:05.826527 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:05.838446 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:05.850329 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:10:05.967592 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:10:06.080936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:06.546036 run create_hlr_db(pid=24397): Launched 10:10:06.671170 bus /sierra_2: Setting Powered False 10:10:07.731184 run create_hlr_db(pid=24397): Terminated: ok {rc=0} 10:10:08.151004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24399): Launched 10:10:08.453389 run osmo-hlr_10.42.42.2(pid=24400): Launched 10:10:08.568569 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:09.085702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24402): Launched 10:10:09.388651 run osmo-stp_10.42.42.5(pid=24403): Launched 10:10:09.503962 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:10.053853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24405): Launched 10:10:10.357213 run osmo-msc_10.42.42.6(pid=24406): Launched 10:10:10.525690 run osmo-stp_10.42.42.5(pid=24403): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24403)] 10:10:10.652256 run osmo-stp_10.42.42.5(pid=24403): stdout: | (launched: 2022-12-09_10:10:09.332454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:10.779086 run osmo-stp_10.42.42.5(pid=24403): stderr: | 20221209101009499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101009499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101009499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101009500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101009500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101009500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101009500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:10.904091 run osmo-stp_10.42.42.5(pid=24403): stdout: | (launched: 2022-12-09_10:10:09.332454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:11.023636 run osmo-stp_10.42.42.5(pid=24403): stderr: | 20221209101009499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101009499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101009499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101009500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101009500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101009500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101009500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:11.166735 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24403): Process ended prematurely: osmo-stp_10.42.42.5(pid=24403) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24403)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:10:11.175864 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:10:11.202732 run osmo-hlr_10.42.42.2(pid=24400): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24400)] 10:10:11.250564 run osmo-hlr_10.42.42.2(pid=24400): stdout: | (launched: 2022-12-09_10:10:08.397109) 10:10:11.300019 run osmo-hlr_10.42.42.2(pid=24400): stderr: | 20221209101008571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101008571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101008572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101008572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101008572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101008572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101008584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101008592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101008593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101008593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:11.368617 run osmo-msc_10.42.42.6(pid=24406): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24406)] 10:10:11.416451 run osmo-msc_10.42.42.6(pid=24406): stdout: | (launched: 2022-12-09_10:10:10.301652) 10:10:11.465657 run osmo-msc_10.42.42.6(pid=24406): stderr: | 20221209101010571 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101010571 DLGLOBAL DEBUG validating counter group 0x7f5c63277c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101010571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101010571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101010571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101010571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101010573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101010573 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101010574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101010574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:11.515449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24399): Terminating (SIGTERM) 10:10:11.555271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24402): Terminating (SIGTERM) 10:10:11.594907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24405): Terminating (SIGTERM) 10:10:11.635255 --- ParallelTerminationStrategy: PID 24399 died... 10:10:11.654641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24399): Terminated: ok {rc=0} 10:10:11.698826 --- ParallelTerminationStrategy: PID 24402 died... 10:10:11.717594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24402): Terminated: ok {rc=0} 10:10:11.761865 --- ParallelTerminationStrategy: PID 24405 died... 10:10:11.780569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24405): Terminated: ok {rc=0} 10:10:11.866907 bus /sierra_3: Setting Powered False 10:10:12.968257 bus /sierra_3: Setting Powered False 10:10:14.085385 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:10:15.231535 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:15.243350 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:10:15.313237 tst mo_mt_call_osmux.py: using LAC 20737 10:10:15.433403 tst mo_mt_call_osmux.py: using RAC 82 10:10:15.552255 tst mo_mt_call_osmux.py: using CellId 20737 10:10:15.670443 tst mo_mt_call_osmux.py: using BVCI 20738 10:10:15.781759 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:15.792695 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:15.803508 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:15.814457 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:15.825780 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:10:15.837370 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:10:15.965626 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:10:16.097923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:16.572544 run create_hlr_db(pid=24408): Launched 10:10:16.730004 bus /sierra_2: Setting Powered False 10:10:17.789684 run create_hlr_db(pid=24408): Terminated: ok {rc=0} 10:10:18.229813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24410): Launched 10:10:18.556567 run osmo-hlr_10.42.42.2(pid=24411): Launched 10:10:18.682283 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:19.245348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24413): Launched 10:10:19.569400 run osmo-stp_10.42.42.5(pid=24414): Launched 10:10:19.695038 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:20.280823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24416): Launched 10:10:20.603824 run osmo-msc_10.42.42.6(pid=24417): Launched 10:10:20.783994 run osmo-stp_10.42.42.5(pid=24414): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24414)] 10:10:20.919370 run osmo-stp_10.42.42.5(pid=24414): stdout: | (launched: 2022-12-09_10:10:19.510366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:21.054766 run osmo-stp_10.42.42.5(pid=24414): stderr: | 20221209101019699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101019699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101019700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101019700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101019701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101019701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101019701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:21.189218 run osmo-stp_10.42.42.5(pid=24414): stdout: | (launched: 2022-12-09_10:10:19.510366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:21.317601 run osmo-stp_10.42.42.5(pid=24414): stderr: | 20221209101019699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101019699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101019700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101019700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101019701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101019701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101019701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:21.472070 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24414): Process ended prematurely: osmo-stp_10.42.42.5(pid=24414) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24414)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:10:21.481924 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:10:21.510698 run osmo-hlr_10.42.42.2(pid=24411): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24411)] 10:10:21.561572 run osmo-hlr_10.42.42.2(pid=24411): stdout: | (launched: 2022-12-09_10:10:18.497360) 10:10:21.614076 run osmo-hlr_10.42.42.2(pid=24411): stderr: | 20221209101018692 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101018692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101018692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101018692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101018692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101018692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101018705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101018714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101018715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101018715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:21.687206 run osmo-msc_10.42.42.6(pid=24417): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24417)] 10:10:21.738174 run osmo-msc_10.42.42.6(pid=24417): stdout: | (launched: 2022-12-09_10:10:20.544781) 10:10:21.790667 run osmo-msc_10.42.42.6(pid=24417): stderr: | 20221209101020865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101020866 DLGLOBAL DEBUG validating counter group 0x7f53586d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101020866 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101020866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101020866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101020866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101020868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101020868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101020868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101020869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:21.843548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24410): Terminating (SIGTERM) 10:10:21.886045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24413): Terminating (SIGTERM) 10:10:21.928789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24416): Terminating (SIGTERM) 10:10:21.971731 --- ParallelTerminationStrategy: PID 24410 died... 10:10:21.992033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24410): Terminated: ok {rc=0} 10:10:22.039564 --- ParallelTerminationStrategy: PID 24413 died... 10:10:22.059372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24413): Terminated: ok {rc=0} 10:10:22.106352 --- ParallelTerminationStrategy: PID 24416 died... 10:10:22.126188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24416): Terminated: ok {rc=0} 10:10:22.215268 bus /sierra_3: Setting Powered False 10:10:23.315566 bus /sierra_3: Setting Powered False 10:10:24.432571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:10:25.682427 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:25.688812 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:10:25.722033 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:10:25.749345 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:10:25.801092 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:10:25.833686 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:10:25.859784 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:10:26.409249 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:10:26.457986 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:26.469186 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:10:26.537743 tst mo_mt_call.py: using LAC 20738 10:10:26.657776 tst mo_mt_call.py: using RAC 83 10:10:26.777802 tst mo_mt_call.py: using CellId 20738 10:10:26.897452 tst mo_mt_call.py: using BVCI 20739 10:10:27.005850 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:27.016817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:27.027615 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:27.038664 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:27.049710 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:27.060599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:10:27.178752 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:10:27.297847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:27.799713 run create_hlr_db(pid=24422): Launched 10:10:27.923510 bus /sierra_2: Setting Powered False 10:10:28.987989 run create_hlr_db(pid=24422): Terminated: ok {rc=0} 10:10:29.437094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Launched 10:10:29.759262 run osmo-hlr_10.42.42.2(pid=24425): Launched 10:10:29.884508 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:30.439278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Launched 10:10:30.762527 run osmo-stp_10.42.42.5(pid=24428): Launched 10:10:30.964811 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:31.622741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24430): Launched 10:10:31.957195 run osmo-msc_10.42.42.6(pid=24431): Launched 10:10:32.278857 run osmo-stp_10.42.42.5(pid=24428): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] 10:10:32.436938 run osmo-stp_10.42.42.5(pid=24428): stdout: | (launched: 2022-12-09_10:10:30.703134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:32.573802 run osmo-stp_10.42.42.5(pid=24428): stderr: | 20221209101030907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101030907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101030907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101030908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101030908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101030908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101030908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:32.709418 run osmo-stp_10.42.42.5(pid=24428): stdout: | (launched: 2022-12-09_10:10:30.703134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:32.838267 run osmo-stp_10.42.42.5(pid=24428): stderr: | 20221209101030907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101030907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101030907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101030908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101030908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101030908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101030908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:32.993134 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24428): Process ended prematurely: osmo-stp_10.42.42.5(pid=24428) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:10:33.003030 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:10:33.032149 run osmo-hlr_10.42.42.2(pid=24425): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24425)] 10:10:33.083147 run osmo-hlr_10.42.42.2(pid=24425): stdout: | (launched: 2022-12-09_10:10:29.700603) 10:10:33.135946 run osmo-hlr_10.42.42.2(pid=24425): stderr: | 20221209101029896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101029896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101029896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101029896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101029896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101029896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101029908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101029918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101029918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101029918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:33.209097 run osmo-msc_10.42.42.6(pid=24431): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24431)] 10:10:33.260010 run osmo-msc_10.42.42.6(pid=24431): stdout: | (launched: 2022-12-09_10:10:31.898271) 10:10:33.312455 run osmo-msc_10.42.42.6(pid=24431): stderr: | 20221209101032380 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101032380 DLGLOBAL DEBUG validating counter group 0x7fac0c1c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101032380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101032380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101032380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101032381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101032382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101032383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101032383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101032383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:33.365897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Terminating (SIGTERM) 10:10:33.408643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Terminating (SIGTERM) 10:10:33.451471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24430): Terminating (SIGTERM) 10:10:33.494361 --- ParallelTerminationStrategy: PID 24424 died... 10:10:33.514851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Terminated: ok {rc=0} 10:10:33.562449 --- ParallelTerminationStrategy: PID 24427 died... 10:10:33.582253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Terminated: ok {rc=0} 10:10:33.629506 --- ParallelTerminationStrategy: PID 24430 died... 10:10:33.649362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24430): Terminated: ok {rc=0} 10:10:33.739413 bus /sierra_3: Setting Powered False 10:10:34.838954 bus /sierra_3: Setting Powered False 10:10:35.953818 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:10:37.104482 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:37.116626 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:10:37.188624 tst mo_mt_call_osmux.py: using LAC 20739 10:10:37.316868 tst mo_mt_call_osmux.py: using RAC 84 10:10:37.436233 tst mo_mt_call_osmux.py: using CellId 20739 10:10:37.554544 tst mo_mt_call_osmux.py: using BVCI 20740 10:10:37.666036 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:37.677268 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:37.688105 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:37.699223 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:37.710565 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:10:37.721555 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:10:37.838374 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:10:37.954824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:38.424903 run create_hlr_db(pid=24433): Launched 10:10:38.548701 bus /sierra_2: Setting Powered False 10:10:39.608515 run create_hlr_db(pid=24433): Terminated: ok {rc=0} 10:10:40.030530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24435): Launched 10:10:40.332593 run osmo-hlr_10.42.42.2(pid=24436): Launched 10:10:40.447079 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:40.963660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24438): Launched 10:10:41.264454 run osmo-stp_10.42.42.5(pid=24439): Launched 10:10:41.380190 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:41.929875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24441): Launched 10:10:42.258215 run osmo-msc_10.42.42.6(pid=24442): Launched 10:10:42.441744 run osmo-stp_10.42.42.5(pid=24439): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24439)] 10:10:42.579282 run osmo-stp_10.42.42.5(pid=24439): stdout: | (launched: 2022-12-09_10:10:41.209076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:42.717463 run osmo-stp_10.42.42.5(pid=24439): stderr: | 20221209101041375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101041375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101041376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101041376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101041377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101041377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101041377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:42.852866 run osmo-stp_10.42.42.5(pid=24439): stdout: | (launched: 2022-12-09_10:10:41.209076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:42.982213 run osmo-stp_10.42.42.5(pid=24439): stderr: | 20221209101041375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101041375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101041376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101041376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101041377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101041377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101041377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:43.137387 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24439): Process ended prematurely: osmo-stp_10.42.42.5(pid=24439) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24439)] [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:10:43.147280 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:10:43.176540 run osmo-hlr_10.42.42.2(pid=24436): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24436)] 10:10:43.227511 run osmo-hlr_10.42.42.2(pid=24436): stdout: | (launched: 2022-12-09_10:10:40.277254) 10:10:43.280226 run osmo-hlr_10.42.42.2(pid=24436): stderr: | 20221209101040453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101040453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101040453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101040453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101040453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101040453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101040464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101040473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101040473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101040473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:43.353385 run osmo-msc_10.42.42.6(pid=24442): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24442)] 10:10:43.404248 run osmo-msc_10.42.42.6(pid=24442): stdout: | (launched: 2022-12-09_10:10:42.199311) 10:10:43.456620 run osmo-msc_10.42.42.6(pid=24442): stderr: | 20221209101042516 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101042516 DLGLOBAL DEBUG validating counter group 0x7fa3656b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101042516 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101042516 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101042516 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101042517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101042518 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101042519 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101042519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101042519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:43.509556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24435): Terminating (SIGTERM) 10:10:43.552160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24438): Terminating (SIGTERM) 10:10:43.594836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24441): Terminating (SIGTERM) 10:10:43.637641 --- ParallelTerminationStrategy: PID 24435 died... 10:10:43.657751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24435): Terminated: ok {rc=0} 10:10:43.704759 --- ParallelTerminationStrategy: PID 24438 died... 10:10:43.724436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24438): Terminated: ok {rc=0} 10:10:43.771358 --- ParallelTerminationStrategy: PID 24441 died... 10:10:43.791036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24441): Terminated: ok {rc=0} 10:10:43.879642 bus /sierra_3: Setting Powered False 10:10:44.978887 bus /sierra_3: Setting Powered False 10:10:46.106367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:10:47.371293 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:47.377864 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:10:47.410438 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:10:47.436646 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:10:47.489926 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:10:47.523400 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:10:47.549466 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:10:48.102762 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:10:48.150823 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:48.161948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:10:48.232130 tst mo_mt_call.py: using LAC 20740 10:10:48.351398 tst mo_mt_call.py: using RAC 85 10:10:48.470743 tst mo_mt_call.py: using CellId 20740 10:10:48.589766 tst mo_mt_call.py: using BVCI 20741 10:10:48.697948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:48.708859 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:48.719867 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:48.730759 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:48.741715 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:48.752517 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:10:48.869098 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:10:48.985503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:49.454328 run create_hlr_db(pid=24448): Launched 10:10:49.579671 bus /sierra_2: Setting Powered False 10:10:50.639079 run create_hlr_db(pid=24448): Terminated: ok {rc=0} 10:10:51.078749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24450): Launched 10:10:51.404507 run osmo-hlr_10.42.42.2(pid=24451): Launched 10:10:51.528666 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:52.083187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24453): Launched 10:10:52.407040 run osmo-stp_10.42.42.5(pid=24454): Launched 10:10:52.531353 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:53.116200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24456): Launched 10:10:53.439944 run osmo-msc_10.42.42.6(pid=24457): Launched 10:10:53.620304 run osmo-stp_10.42.42.5(pid=24454): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24454)] 10:10:53.757464 run osmo-stp_10.42.42.5(pid=24454): stdout: | (launched: 2022-12-09_10:10:52.347955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:53.894458 run osmo-stp_10.42.42.5(pid=24454): stderr: | 20221209101052535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101052536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101052536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101052536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101052537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101052537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101052537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:54.029654 run osmo-stp_10.42.42.5(pid=24454): stdout: | (launched: 2022-12-09_10:10:52.347955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:54.158413 run osmo-stp_10.42.42.5(pid=24454): stderr: | 20221209101052535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101052536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101052536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101052536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101052537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101052537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101052537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:54.312657 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24454): Process ended prematurely: osmo-stp_10.42.42.5(pid=24454) [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24454)] [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:10:54.322594 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:10:54.351787 run osmo-hlr_10.42.42.2(pid=24451): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24451)] 10:10:54.402726 run osmo-hlr_10.42.42.2(pid=24451): stdout: | (launched: 2022-12-09_10:10:51.344756) 10:10:54.455053 run osmo-hlr_10.42.42.2(pid=24451): stderr: | 20221209101051539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101051539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101051539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101051539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101051539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101051539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101051551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101051560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101051560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101051560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:54.527643 run osmo-msc_10.42.42.6(pid=24457): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24457)] 10:10:54.577923 run osmo-msc_10.42.42.6(pid=24457): stdout: | (launched: 2022-12-09_10:10:53.380733) 10:10:54.630039 run osmo-msc_10.42.42.6(pid=24457): stderr: | 20221209101053698 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101053699 DLGLOBAL DEBUG validating counter group 0x7fa986aecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101053699 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101053699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101053699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101053699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101053701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101053701 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101053701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101053702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:54.682669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24450): Terminating (SIGTERM) 10:10:54.725271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24453): Terminating (SIGTERM) 10:10:54.767449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24456): Terminating (SIGTERM) 10:10:54.810169 --- ParallelTerminationStrategy: PID 24450 died... 10:10:54.830273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24450): Terminated: ok {rc=0} 10:10:54.877376 --- ParallelTerminationStrategy: PID 24453 died... 10:10:54.897117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24453): Terminated: ok {rc=0} 10:10:54.943953 --- ParallelTerminationStrategy: PID 24456 died... 10:10:54.963750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24456): Terminated: ok {rc=0} 10:10:55.052567 bus /sierra_3: Setting Powered False 10:10:56.152848 bus /sierra_3: Setting Powered False 10:10:57.269802 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:10:58.420261 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:58.432650 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:10:58.505921 tst mo_mt_call_osmux.py: using LAC 20741 10:10:58.633656 tst mo_mt_call_osmux.py: using RAC 86 10:10:58.762114 tst mo_mt_call_osmux.py: using CellId 20741 10:10:58.890384 tst mo_mt_call_osmux.py: using BVCI 20742 10:10:59.000238 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:59.011404 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:59.022325 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:59.033717 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:59.045193 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:10:59.056529 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:10:59.171258 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:10:59.288149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:59.756501 run create_hlr_db(pid=24459): Launched 10:10:59.880021 bus /sierra_2: Setting Powered False 10:11:00.949123 run create_hlr_db(pid=24459): Terminated: ok {rc=0} 10:11:01.431416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24461): Launched 10:11:01.759775 run osmo-hlr_10.42.42.2(pid=24462): Launched 10:11:02.044424 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:02.709676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24464): Launched 10:11:03.035149 run osmo-stp_10.42.42.5(pid=24465): Launched 10:11:03.159073 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:03.743341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24467): Launched 10:11:04.066533 run osmo-msc_10.42.42.6(pid=24468): Launched 10:11:04.247355 run osmo-stp_10.42.42.5(pid=24465): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24465)] 10:11:04.384868 run osmo-stp_10.42.42.5(pid=24465): stdout: | (launched: 2022-12-09_10:11:02.976076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:04.522756 run osmo-stp_10.42.42.5(pid=24465): stderr: | 20221209101103164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101103164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101103164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101103165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101103165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101103165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101103166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:04.657861 run osmo-stp_10.42.42.5(pid=24465): stdout: | (launched: 2022-12-09_10:11:02.976076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:04.786780 run osmo-stp_10.42.42.5(pid=24465): stderr: | 20221209101103164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101103164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101103164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101103165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101103165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101103165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101103166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:04.941140 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24465): Process ended prematurely: osmo-stp_10.42.42.5(pid=24465) [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24465)] [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:11:04.950998 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:11:04.979665 run osmo-hlr_10.42.42.2(pid=24462): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24462)] 10:11:05.030195 run osmo-hlr_10.42.42.2(pid=24462): stdout: | (launched: 2022-12-09_10:11:01.696159) 10:11:05.082396 run osmo-hlr_10.42.42.2(pid=24462): stderr: | 20221209101102020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101102023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101102023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101102024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101102024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101102025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101102042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101102060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101102061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101102062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:05.155129 run osmo-msc_10.42.42.6(pid=24468): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24468)] 10:11:05.206072 run osmo-msc_10.42.42.6(pid=24468): stdout: | (launched: 2022-12-09_10:11:04.007001) 10:11:05.258348 run osmo-msc_10.42.42.6(pid=24468): stderr: | 20221209101104323 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101104324 DLGLOBAL DEBUG validating counter group 0x7f6bb3946c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101104324 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101104324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101104324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101104324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101104326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101104326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101104326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101104326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:05.310631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24461): Terminating (SIGTERM) 10:11:05.352737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24464): Terminating (SIGTERM) 10:11:05.395340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24467): Terminating (SIGTERM) 10:11:05.437724 --- ParallelTerminationStrategy: PID 24461 died... 10:11:05.457724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24461): Terminated: ok {rc=0} 10:11:05.504425 --- ParallelTerminationStrategy: PID 24464 died... 10:11:05.523938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24464): Terminated: ok {rc=0} 10:11:05.570323 --- ParallelTerminationStrategy: PID 24467 died... 10:11:05.589730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24467): Terminated: ok {rc=0} 10:11:05.677465 bus /sierra_3: Setting Powered False 10:11:06.776437 bus /sierra_3: Setting Powered False 10:11:07.892780 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:11:09.141498 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:09.147226 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:11:09.179983 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:11:09.206331 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:11:09.258979 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:11:09.291778 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:11:09.317715 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:11:09.864750 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:11:09.912539 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:09.923341 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:11:09.993063 tst mo_mt_call.py: using LAC 20742 10:11:10.111671 tst mo_mt_call.py: using RAC 87 10:11:10.230693 tst mo_mt_call.py: using CellId 20742 10:11:10.357764 tst mo_mt_call.py: using BVCI 20743 10:11:10.477689 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:10.489155 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:10.500388 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:10.512106 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:10.523885 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:10.535591 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:11:10.655686 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:11:10.772097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:11.238836 run create_hlr_db(pid=24473): Launched 10:11:11.365395 bus /sierra_2: Setting Powered False 10:11:12.425641 run create_hlr_db(pid=24473): Terminated: ok {rc=0} 10:11:12.865407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24475): Launched 10:11:13.188075 run osmo-hlr_10.42.42.2(pid=24476): Launched 10:11:13.312065 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:13.873850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24478): Launched 10:11:14.197677 run osmo-stp_10.42.42.5(pid=24479): Launched 10:11:14.321721 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:14.910485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24481): Launched 10:11:15.235519 run osmo-msc_10.42.42.6(pid=24482): Launched 10:11:15.418543 run osmo-stp_10.42.42.5(pid=24479): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24479)] 10:11:15.554503 run osmo-stp_10.42.42.5(pid=24479): stdout: | (launched: 2022-12-09_10:11:14.138215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:15.690854 run osmo-stp_10.42.42.5(pid=24479): stderr: | 20221209101114326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101114326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101114326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101114327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101114327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101114327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101114327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:15.826404 run osmo-stp_10.42.42.5(pid=24479): stdout: | (launched: 2022-12-09_10:11:14.138215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:15.968078 run osmo-stp_10.42.42.5(pid=24479): stderr: | 20221209101114326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101114326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101114326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101114327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101114327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101114327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101114327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:16.128237 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24479): Process ended prematurely: osmo-stp_10.42.42.5(pid=24479) [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24479)] [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:11:16.138957 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:11:16.170531 run osmo-hlr_10.42.42.2(pid=24476): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24476)] 10:11:16.223481 run osmo-hlr_10.42.42.2(pid=24476): stdout: | (launched: 2022-12-09_10:11:13.129446) 10:11:16.277715 run osmo-hlr_10.42.42.2(pid=24476): stderr: | 20221209101113322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101113322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101113322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101113322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101113322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101113322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101113334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101113343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101113344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101113344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:16.353231 run osmo-msc_10.42.42.6(pid=24482): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24482)] 10:11:16.407544 run osmo-msc_10.42.42.6(pid=24482): stdout: | (launched: 2022-12-09_10:11:15.176330) 10:11:16.470677 run osmo-msc_10.42.42.6(pid=24482): stderr: | 20221209101115497 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101115497 DLGLOBAL DEBUG validating counter group 0x7f7827170c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101115497 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101115497 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101115497 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101115498 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101115499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101115500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101115500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101115500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:16.533172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24475): Terminating (SIGTERM) 10:11:16.582594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24478): Terminating (SIGTERM) 10:11:16.627052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24481): Terminating (SIGTERM) 10:11:16.671837 --- ParallelTerminationStrategy: PID 24475 died... 10:11:16.692563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24475): Terminated: ok {rc=0} 10:11:16.742835 --- ParallelTerminationStrategy: PID 24478 died... 10:11:16.763413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24478): Terminated: ok {rc=0} 10:11:16.813348 --- ParallelTerminationStrategy: PID 24481 died... 10:11:16.834141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24481): Terminated: ok {rc=0} 10:11:16.927465 bus /sierra_3: Setting Powered False 10:11:18.028676 bus /sierra_3: Setting Powered False 10:11:19.145764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:11:20.295994 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:20.308313 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:11:20.382173 tst mo_mt_call_osmux.py: using LAC 20743 10:11:20.509139 tst mo_mt_call_osmux.py: using RAC 88 10:11:20.635246 tst mo_mt_call_osmux.py: using CellId 20743 10:11:20.764525 tst mo_mt_call_osmux.py: using BVCI 20744 10:11:20.882486 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:20.894093 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:20.905280 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:20.916859 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:20.928350 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:11:20.940143 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:11:21.057973 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:11:21.178616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:21.681529 run create_hlr_db(pid=24484): Launched 10:11:21.806161 bus /sierra_2: Setting Powered False 10:11:22.869889 run create_hlr_db(pid=24484): Terminated: ok {rc=0} 10:11:23.299770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24486): Launched 10:11:23.602429 run osmo-hlr_10.42.42.2(pid=24487): Launched 10:11:23.718855 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:24.237649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24489): Launched 10:11:24.541770 run osmo-stp_10.42.42.5(pid=24490): Launched 10:11:24.659330 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:25.207692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24492): Launched 10:11:25.510639 run osmo-msc_10.42.42.6(pid=24493): Launched 10:11:25.684342 run osmo-stp_10.42.42.5(pid=24490): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24490)] 10:11:25.812005 run osmo-stp_10.42.42.5(pid=24490): stdout: | (launched: 2022-12-09_10:11:24.485589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:25.939145 run osmo-stp_10.42.42.5(pid=24490): stderr: | 20221209101124654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101124654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101124654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101124655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101124655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101124655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101124655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:26.064524 run osmo-stp_10.42.42.5(pid=24490): stdout: | (launched: 2022-12-09_10:11:24.485589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:26.184622 run osmo-stp_10.42.42.5(pid=24490): stderr: | 20221209101124654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101124654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101124654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101124655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101124655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101124655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101124655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:26.329990 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24490): Process ended prematurely: osmo-stp_10.42.42.5(pid=24490) [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24490)] [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:11:26.338911 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:11:26.365525 run osmo-hlr_10.42.42.2(pid=24487): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24487)] 10:11:26.413609 run osmo-hlr_10.42.42.2(pid=24487): stdout: | (launched: 2022-12-09_10:11:23.546107) 10:11:26.463026 run osmo-hlr_10.42.42.2(pid=24487): stderr: | 20221209101123719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101123719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101123719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101123719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101123719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101123719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101123731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101123739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101123740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101123740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:26.532336 run osmo-msc_10.42.42.6(pid=24493): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24493)] 10:11:26.580555 run osmo-msc_10.42.42.6(pid=24493): stdout: | (launched: 2022-12-09_10:11:25.454429) 10:11:26.629910 run osmo-msc_10.42.42.6(pid=24493): stderr: | 20221209101125723 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101125723 DLGLOBAL DEBUG validating counter group 0x7ff631595c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101125723 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101125723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101125723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101125724 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101125725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101125726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101125726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101125726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:26.679792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24486): Terminating (SIGTERM) 10:11:26.719788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24489): Terminating (SIGTERM) 10:11:26.759674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24492): Terminating (SIGTERM) 10:11:26.799667 --- ParallelTerminationStrategy: PID 24486 died... 10:11:26.818814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24486): Terminated: ok {rc=0} 10:11:26.863454 --- ParallelTerminationStrategy: PID 24489 died... 10:11:26.882062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24489): Terminated: ok {rc=0} 10:11:26.926023 --- ParallelTerminationStrategy: PID 24492 died... 10:11:26.944687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24492): Terminated: ok {rc=0} 10:11:27.030382 bus /sierra_3: Setting Powered False 10:11:28.130700 bus /sierra_3: Setting Powered False 10:11:29.243829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 10:11:30.496442 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:30.501320 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 10:11:30.533611 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 10:11:30.560042 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 10:11:30.611143 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 10:11:30.643264 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 10:11:30.669133 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 10:11:31.239575 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 10:11:31.298177 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:31.310943 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:11:31.368674 tst mo_mt_call.py: using LAC 20744 10:11:31.499374 tst mo_mt_call.py: using RAC 89 10:11:31.629130 tst mo_mt_call.py: using CellId 20744 10:11:31.785632 tst mo_mt_call.py: using BVCI 20745 10:11:31.931168 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:31.947269 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:31.961228 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:31.975044 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:31.988798 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:32.002737 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:11:32.126554 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:11:32.252492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:32.724397 run create_hlr_db(pid=24499): Launched 10:11:32.850075 bus /sierra_2: Setting Powered False 10:11:33.910500 run create_hlr_db(pid=24499): Terminated: ok {rc=0} 10:11:34.351050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24501): Launched 10:11:34.676609 run osmo-hlr_10.42.42.2(pid=24502): Launched 10:11:34.801634 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:35.360698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24504): Launched 10:11:35.684648 run osmo-stp_10.42.42.5(pid=24505): Launched 10:11:35.808150 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:36.392235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24507): Launched 10:11:36.716074 run osmo-msc_10.42.42.6(pid=24508): Launched 10:11:36.896357 run osmo-stp_10.42.42.5(pid=24505): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24505)] 10:11:37.031726 run osmo-stp_10.42.42.5(pid=24505): stdout: | (launched: 2022-12-09_10:11:35.625830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:37.168340 run osmo-stp_10.42.42.5(pid=24505): stderr: | 20221209101135811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101135811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101135812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101135812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101135812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101135813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101135813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:37.302915 run osmo-stp_10.42.42.5(pid=24505): stdout: | (launched: 2022-12-09_10:11:35.625830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:37.432047 run osmo-stp_10.42.42.5(pid=24505): stderr: | 20221209101135811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101135811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101135812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101135812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101135812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101135813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101135813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:37.586999 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24505): Process ended prematurely: osmo-stp_10.42.42.5(pid=24505) [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24505)] [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 10:11:37.596748 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:11:37.625315 run osmo-hlr_10.42.42.2(pid=24502): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24502)] 10:11:37.675875 run osmo-hlr_10.42.42.2(pid=24502): stdout: | (launched: 2022-12-09_10:11:34.617967) 10:11:37.728188 run osmo-hlr_10.42.42.2(pid=24502): stderr: | 20221209101134813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101134813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101134813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101134813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101134813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101134813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101134824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101134833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101134834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101134834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:37.800923 run osmo-msc_10.42.42.6(pid=24508): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24508)] 10:11:37.851438 run osmo-msc_10.42.42.6(pid=24508): stdout: | (launched: 2022-12-09_10:11:36.656779) 10:11:37.903490 run osmo-msc_10.42.42.6(pid=24508): stderr: | 20221209101136975 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101136975 DLGLOBAL DEBUG validating counter group 0x7fdf6330ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101136976 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101136976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101136976 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101136976 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101136978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101136978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101136978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101136979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:37.956004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24501): Terminating (SIGTERM) 10:11:37.998155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24504): Terminating (SIGTERM) 10:11:38.040482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24507): Terminating (SIGTERM) 10:11:38.082786 --- ParallelTerminationStrategy: PID 24501 died... 10:11:38.102881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24501): Terminated: ok {rc=0} 10:11:38.149786 --- ParallelTerminationStrategy: PID 24504 died... 10:11:38.169449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24504): Terminated: ok {rc=0} 10:11:38.216128 --- ParallelTerminationStrategy: PID 24507 died... 10:11:38.235864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24507): Terminated: ok {rc=0} 10:11:38.325106 bus /sierra_3: Setting Powered False 10:11:39.425439 bus /sierra_3: Setting Powered False 10:11:40.542905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 10:11:41.689482 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:41.701093 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:11:41.752008 tst mo_mt_call_osmux.py: using LAC 20745 10:11:41.870105 tst mo_mt_call_osmux.py: using RAC 90 10:11:41.990036 tst mo_mt_call_osmux.py: using CellId 20745 10:11:42.108265 tst mo_mt_call_osmux.py: using BVCI 20746 10:11:42.218337 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:42.229279 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:42.239839 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:42.250912 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:42.261710 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:11:42.272332 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:11:42.387377 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:11:42.507303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:43.009455 run create_hlr_db(pid=24510): Launched 10:11:43.134660 bus /sierra_2: Setting Powered False 10:11:44.198541 run create_hlr_db(pid=24510): Terminated: ok {rc=0} 10:11:44.629998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24512): Launched 10:11:44.930212 run osmo-hlr_10.42.42.2(pid=24513): Launched 10:11:45.045368 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:45.563060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24515): Launched 10:11:45.881784 run osmo-stp_10.42.42.5(pid=24516): Launched 10:11:46.102746 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:46.794696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24518): Launched 10:11:47.156738 run osmo-msc_10.42.42.6(pid=24519): Launched 10:11:47.354736 run osmo-stp_10.42.42.5(pid=24516): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24516)] 10:11:47.504506 run osmo-stp_10.42.42.5(pid=24516): stdout: | (launched: 2022-12-09_10:11:45.809232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:47.643199 run osmo-stp_10.42.42.5(pid=24516): stderr: | 20221209101146103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101146104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101146104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101146104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101146105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101146105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101146105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:47.782536 run osmo-stp_10.42.42.5(pid=24516): stdout: | (launched: 2022-12-09_10:11:45.809232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:47.912765 run osmo-stp_10.42.42.5(pid=24516): stderr: | 20221209101146103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101146104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101146104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101146104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101146105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101146105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101146105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:48.067962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24516): Process ended prematurely: osmo-stp_10.42.42.5(pid=24516) [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24516)] [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 10:11:48.077821 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:11:48.106658 run osmo-hlr_10.42.42.2(pid=24513): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24513)] 10:11:48.157423 run osmo-hlr_10.42.42.2(pid=24513): stdout: | (launched: 2022-12-09_10:11:44.875145) 10:11:48.209921 run osmo-hlr_10.42.42.2(pid=24513): stderr: | 20221209101145048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101145049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101145049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101145049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101145049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101145049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101145061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101145070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101145070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101145070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:48.282888 run osmo-msc_10.42.42.6(pid=24519): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24519)] 10:11:48.333727 run osmo-msc_10.42.42.6(pid=24519): stdout: | (launched: 2022-12-09_10:11:47.073545) 10:11:48.386152 run osmo-msc_10.42.42.6(pid=24519): stderr: | 20221209101147552 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101147552 DLGLOBAL DEBUG validating counter group 0x7f1722c73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101147552 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101147552 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101147552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101147553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101147554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101147555 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101147555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101147555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:48.439506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24512): Terminating (SIGTERM) 10:11:48.482139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24515): Terminating (SIGTERM) 10:11:48.524640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24518): Terminating (SIGTERM) 10:11:48.567407 --- ParallelTerminationStrategy: PID 24512 died... 10:11:48.587528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24512): Terminated: ok {rc=0} 10:11:48.634614 --- ParallelTerminationStrategy: PID 24515 died... 10:11:48.654389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24515): Terminated: ok {rc=0} 10:11:48.701397 --- ParallelTerminationStrategy: PID 24518 died... 10:11:48.721039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24518): Terminated: ok {rc=0} 10:11:48.809562 bus /sierra_3: Setting Powered False 10:11:49.907915 bus /sierra_3: Setting Powered False 10:11:51.022309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:11:52.278882 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:52.285777 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:11:52.320651 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:11:52.348472 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:11:52.399775 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:11:52.434156 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:11:52.461907 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:11:53.015375 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:11:53.067503 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:11:53.079190 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:11:53.131850 tst mo_mt_call.py: using LAC 20746 10:11:53.250533 tst mo_mt_call.py: using RAC 91 10:11:53.369092 tst mo_mt_call.py: using CellId 20746 10:11:53.485784 tst mo_mt_call.py: using BVCI 20747 10:11:53.594133 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:11:53.605451 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:11:53.616480 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:11:53.627483 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:11:53.638530 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:11:53.649483 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:11:53.767298 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:11:53.886912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:54.388653 run create_hlr_db(pid=24524): Launched 10:11:54.514849 bus /sierra_2: Setting Powered False 10:11:55.578659 run create_hlr_db(pid=24524): Terminated: ok {rc=0} 10:11:56.027298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24526): Launched 10:11:56.351457 run osmo-hlr_10.42.42.2(pid=24527): Launched 10:11:56.475866 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:57.029553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24529): Launched 10:11:57.354748 run osmo-stp_10.42.42.5(pid=24530): Launched 10:11:57.479356 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:58.067370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24532): Launched 10:11:58.394063 run osmo-msc_10.42.42.6(pid=24533): Launched 10:11:58.575732 run osmo-stp_10.42.42.5(pid=24530): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24530)] 10:11:58.712037 run osmo-stp_10.42.42.5(pid=24530): stdout: | (launched: 2022-12-09_10:11:57.295141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:58.848505 run osmo-stp_10.42.42.5(pid=24530): stderr: | 20221209101157483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101157483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101157483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101157484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101157484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101157484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101157484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:58.983474 run osmo-stp_10.42.42.5(pid=24530): stdout: | (launched: 2022-12-09_10:11:57.295141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:59.112188 run osmo-stp_10.42.42.5(pid=24530): stderr: | 20221209101157483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101157483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101157483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101157484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101157484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101157484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101157484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:59.266680 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24530): Process ended prematurely: osmo-stp_10.42.42.5(pid=24530) [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24530)] [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:11:59.276339 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:11:59.305090 run osmo-hlr_10.42.42.2(pid=24527): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24527)] 10:11:59.355431 run osmo-hlr_10.42.42.2(pid=24527): stdout: | (launched: 2022-12-09_10:11:56.292713) 10:11:59.408229 run osmo-hlr_10.42.42.2(pid=24527): stderr: | 20221209101156487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101156487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101156487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101156487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101156487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101156487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101156503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101156513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101156513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101156513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:59.480866 run osmo-msc_10.42.42.6(pid=24533): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24533)] 10:11:59.531215 run osmo-msc_10.42.42.6(pid=24533): stdout: | (launched: 2022-12-09_10:11:58.334419) 10:11:59.583128 run osmo-msc_10.42.42.6(pid=24533): stderr: | 20221209101158654 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101158654 DLGLOBAL DEBUG validating counter group 0x7f3add02dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101158654 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101158654 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101158655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101158655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101158656 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101158657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101158657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101158657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:59.635461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24526): Terminating (SIGTERM) 10:11:59.677498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24529): Terminating (SIGTERM) 10:11:59.719635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24532): Terminating (SIGTERM) 10:11:59.762053 --- ParallelTerminationStrategy: PID 24526 died... 10:11:59.781970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24526): Terminated: ok {rc=0} 10:11:59.828567 --- ParallelTerminationStrategy: PID 24529 died... 10:11:59.848144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24529): Terminated: ok {rc=0} 10:11:59.894686 --- ParallelTerminationStrategy: PID 24532 died... 10:11:59.914187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24532): Terminated: ok {rc=0} 10:12:00.002037 bus /sierra_3: Setting Powered False 10:12:01.114987 bus /sierra_3: Setting Powered False 10:12:02.246698 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:12:03.393065 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:12:03.404753 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:12:03.462747 tst mo_mt_call_osmux.py: using LAC 20747 10:12:03.579843 tst mo_mt_call_osmux.py: using RAC 92 10:12:03.696805 tst mo_mt_call_osmux.py: using CellId 20747 10:12:03.813148 tst mo_mt_call_osmux.py: using BVCI 20748 10:12:03.922087 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:12:03.933335 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:12:03.944322 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:12:03.955418 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:12:03.966627 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:12:03.977719 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:12:04.092238 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:12:04.216524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:04.720062 run create_hlr_db(pid=24535): Launched 10:12:04.843946 bus /sierra_2: Setting Powered False 10:12:05.907235 run create_hlr_db(pid=24535): Terminated: ok {rc=0} 10:12:06.338620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24537): Launched 10:12:06.642451 run osmo-hlr_10.42.42.2(pid=24538): Launched 10:12:06.758991 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:07.293973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24540): Launched 10:12:07.594503 run osmo-stp_10.42.42.5(pid=24541): Launched 10:12:07.709301 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:08.253822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24543): Launched 10:12:08.554710 run osmo-msc_10.42.42.6(pid=24544): Launched 10:12:08.725561 run osmo-stp_10.42.42.5(pid=24541): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24541)] 10:12:08.852225 run osmo-stp_10.42.42.5(pid=24541): stdout: | (launched: 2022-12-09_10:12:07.539364) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:08.978969 run osmo-stp_10.42.42.5(pid=24541): stderr: | 20221209101207707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101207707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101207708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101207708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101207709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101207709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101207709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:09.104200 run osmo-stp_10.42.42.5(pid=24541): stdout: | (launched: 2022-12-09_10:12:07.539364) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:09.223600 run osmo-stp_10.42.42.5(pid=24541): stderr: | 20221209101207707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101207707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101207708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101207708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101207709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101207709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101207709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:09.366630 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24541): Process ended prematurely: osmo-stp_10.42.42.5(pid=24541) [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24541)] [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:12:09.375684 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:12:09.402188 run osmo-hlr_10.42.42.2(pid=24538): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24538)] 10:12:09.449758 run osmo-hlr_10.42.42.2(pid=24538): stdout: | (launched: 2022-12-09_10:12:06.586336) 10:12:09.499107 run osmo-hlr_10.42.42.2(pid=24538): stderr: | 20221209101206759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101206759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101206759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101206759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101206759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101206759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101206771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101206780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101206780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101206780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:09.567794 run osmo-msc_10.42.42.6(pid=24544): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24544)] 10:12:09.615157 run osmo-msc_10.42.42.6(pid=24544): stdout: | (launched: 2022-12-09_10:12:08.498980) 10:12:09.664090 run osmo-msc_10.42.42.6(pid=24544): stderr: | 20221209101208768 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101208768 DLGLOBAL DEBUG validating counter group 0x7f8051ae8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101208768 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101208768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101208768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101208769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101208770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101208771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101208771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101208771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:09.713352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24537): Terminating (SIGTERM) 10:12:09.752718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24540): Terminating (SIGTERM) 10:12:09.792123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24543): Terminating (SIGTERM) 10:12:09.832043 --- ParallelTerminationStrategy: PID 24537 died... 10:12:09.851089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24537): Terminated: ok {rc=0} 10:12:09.894894 --- ParallelTerminationStrategy: PID 24540 died... 10:12:09.913322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24540): Terminated: ok {rc=0} 10:12:09.956869 --- ParallelTerminationStrategy: PID 24543 died... 10:12:09.975773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24543): Terminated: ok {rc=0} 10:12:10.061355 bus /sierra_3: Setting Powered False 10:12:11.161192 bus /sierra_3: Setting Powered False 10:12:12.277611 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:trx-b200 --------------------------------------------------------------------- 10:12:13.524425 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:13.530344 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 10:12:13.566027 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:12:13.593525 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 10:12:13.680054 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 10:12:13.713967 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:12:13.741198 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 10:12:14.325500 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 10:12:14.330882 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:14.342124 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:12:14.393244 tst emergency_mo_mt_call.py: using LAC 20748 10:12:14.518408 tst emergency_mo_mt_call.py: using RAC 93 10:12:14.643392 tst emergency_mo_mt_call.py: using CellId 20748 10:12:14.768369 tst emergency_mo_mt_call.py: using BVCI 20749 10:12:14.883769 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:14.894891 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:14.905735 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:14.916762 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:14.927992 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:14.939191 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:12:15.053345 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:12:15.171343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:15.664310 run create_hlr_db(pid=24549): Launched 10:12:15.786175 bus /sierra_2: Setting Powered False 10:12:16.860071 run create_hlr_db(pid=24549): Terminated: ok {rc=0} 10:12:17.371513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24551): Launched 10:12:17.669369 run osmo-hlr_10.42.42.2(pid=24552): Launched 10:12:17.782745 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:18.310880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24554): Launched 10:12:18.608215 run osmo-stp_10.42.42.5(pid=24555): Launched 10:12:18.731640 tst emergency_mo_mt_call.py: using MSISDN 7156 10:12:18.881466 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:19.416520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24557): Launched 10:12:19.713384 run osmo-msc_10.42.42.6(pid=24558): Launched 10:12:19.879459 run osmo-stp_10.42.42.5(pid=24555): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24555)] 10:12:20.004237 run osmo-stp_10.42.42.5(pid=24555): stdout: | (launched: 2022-12-09_10:12:18.553437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:20.129087 run osmo-stp_10.42.42.5(pid=24555): stderr: | 20221209101218722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101218722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101218722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101218723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101218723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101218723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101218723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:20.252142 run osmo-stp_10.42.42.5(pid=24555): stdout: | (launched: 2022-12-09_10:12:18.553437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:20.370005 run osmo-stp_10.42.42.5(pid=24555): stderr: | 20221209101218722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101218722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101218722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101218723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101218723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101218723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101218723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:20.510659 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24555): Process ended prematurely: osmo-stp_10.42.42.5(pid=24555) [trial-2358↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24555)] [trial-2358↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 10:12:20.519072 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:12:20.545335 run osmo-hlr_10.42.42.2(pid=24552): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24552)] 10:12:20.592933 run osmo-hlr_10.42.42.2(pid=24552): stdout: | (launched: 2022-12-09_10:12:17.613682) 10:12:20.642489 run osmo-hlr_10.42.42.2(pid=24552): stderr: | 20221209101217787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101217787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101217787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101217787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101217788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101217788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101217798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101217807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101217807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101217807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:20.711768 run osmo-msc_10.42.42.6(pid=24558): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24558)] 10:12:20.759394 run osmo-msc_10.42.42.6(pid=24558): stdout: | (launched: 2022-12-09_10:12:19.658561) 10:12:20.808828 run osmo-msc_10.42.42.6(pid=24558): stderr: | 20221209101219927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101219927 DLGLOBAL DEBUG validating counter group 0x7f941dcb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101219927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101219927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101219927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101219927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101219930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101219931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101219931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101219931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:20.858359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24551): Terminating (SIGTERM) 10:12:20.897937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24554): Terminating (SIGTERM) 10:12:20.937395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24557): Terminating (SIGTERM) 10:12:20.977197 --- ParallelTerminationStrategy: PID 24551 died... 10:12:20.996060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24551): Terminated: ok {rc=0} 10:12:21.039907 --- ParallelTerminationStrategy: PID 24554 died... 10:12:21.058512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24554): Terminated: ok {rc=0} 10:12:21.102062 --- ParallelTerminationStrategy: PID 24557 died... 10:12:21.120549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24557): Terminated: ok {rc=0} 10:12:21.203218 bus /sierra_3: Setting Powered False 10:12:22.301723 bus /sierra_3: Setting Powered False 10:12:23.420735 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 10:12:24.509360 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:24.520616 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:12:24.571512 tst emergency_preemptive_call.py: using LAC 20749 10:12:24.688152 tst emergency_preemptive_call.py: using RAC 94 10:12:24.807225 tst emergency_preemptive_call.py: using CellId 20749 10:12:24.925081 tst emergency_preemptive_call.py: using BVCI 20750 10:12:25.031709 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:25.042383 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:25.052680 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:25.063002 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:25.073337 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:12:25.083611 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:12:25.200708 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:12:25.317192 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:12:25.433550 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:12:25.551980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:26.013586 run create_hlr_db(pid=24560): Launched 10:12:26.135842 bus /sierra_2: Setting Powered False 10:12:27.195939 run create_hlr_db(pid=24560): Terminated: ok {rc=0} 10:12:27.633537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24562): Launched 10:12:27.955769 run osmo-hlr_10.42.42.2(pid=24563): Launched 10:12:28.077962 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:28.624900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24565): Launched 10:12:28.942708 run osmo-stp_10.42.42.5(pid=24566): Launched 10:12:29.072274 tst emergency_preemptive_call.py: using MSISDN 7157 10:12:29.234798 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:29.806790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24568): Launched 10:12:30.125190 run osmo-msc_10.42.42.6(pid=24569): Launched 10:12:30.302756 run osmo-stp_10.42.42.5(pid=24566): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24566)] 10:12:30.437352 run osmo-stp_10.42.42.5(pid=24566): stdout: | (launched: 2022-12-09_10:12:28.884682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:30.572219 run osmo-stp_10.42.42.5(pid=24566): stderr: | 20221209101229073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101229073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101229074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101229074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101229075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101229075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101229075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:30.705676 run osmo-stp_10.42.42.5(pid=24566): stdout: | (launched: 2022-12-09_10:12:28.884682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:30.843776 run osmo-stp_10.42.42.5(pid=24566): stderr: | 20221209101229073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101229073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101229074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101229074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101229075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101229075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101229075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:31.006467 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24566): Process ended prematurely: osmo-stp_10.42.42.5(pid=24566) [trial-2358↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24566)] [trial-2358↪emergency:trx-b200↪emergency_preemptive_call.py:32] 10:12:31.019100 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 10:12:31.056504 run osmo-hlr_10.42.42.2(pid=24563): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24563)] 10:12:31.116397 run osmo-hlr_10.42.42.2(pid=24563): stdout: | (launched: 2022-12-09_10:12:27.896791) 10:12:31.179486 run osmo-hlr_10.42.42.2(pid=24563): stderr: | 20221209101228091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101228091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101228091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101228091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101228091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101228091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101228102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101228110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101228110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101228111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:31.266882 run osmo-msc_10.42.42.6(pid=24569): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24569)] 10:12:31.320273 run osmo-msc_10.42.42.6(pid=24569): stdout: | (launched: 2022-12-09_10:12:30.066573) 10:12:31.375120 run osmo-msc_10.42.42.6(pid=24569): stderr: | 20221209101230384 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101230384 DLGLOBAL DEBUG validating counter group 0x7ff8a2767c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101230384 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101230385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101230385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101230385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101230387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101230387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101230387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101230387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:31.430441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24562): Terminating (SIGTERM) 10:12:31.475067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24565): Terminating (SIGTERM) 10:12:31.519987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24568): Terminating (SIGTERM) 10:12:31.565461 --- ParallelTerminationStrategy: PID 24562 died... 10:12:31.586635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24562): Terminated: ok {rc=0} 10:12:31.638068 --- ParallelTerminationStrategy: PID 24565 died... 10:12:31.658822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24565): Terminated: ok {rc=0} 10:12:31.709170 --- ParallelTerminationStrategy: PID 24568 died... 10:12:31.730146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24568): Terminated: ok {rc=0} 10:12:31.823118 bus /sierra_9: Setting Powered False 10:12:32.924172 bus /sierra_9: Setting Powered False 10:12:34.039937 bus /sierra_8: Setting Powered False 10:12:35.137924 bus /sierra_8: Setting Powered False 10:12:36.253577 bus /sierra_3: Setting Powered False 10:12:37.353163 bus /sierra_3: Setting Powered False 10:12:38.471192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-b200 --------------------------------------------------------------------- 10:12:39.748064 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:39.752470 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 10:12:39.785118 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 10:12:39.822839 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 10:12:39.908609 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 10:12:39.941139 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 10:12:39.978617 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 10:12:40.566833 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 10:12:40.616133 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:40.626809 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:12:40.675283 tst cs_paging_gprs_active.py: using LAC 20750 10:12:40.793345 tst cs_paging_gprs_active.py: using RAC 95 10:12:40.912585 tst cs_paging_gprs_active.py: using CellId 20750 10:12:41.032458 tst cs_paging_gprs_active.py: using BVCI 20751 10:12:41.144026 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.154542 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.164780 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.175055 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.185424 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.195569 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.205951 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.216099 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:41.226644 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:12:41.345929 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:12:41.462608 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:12:41.682292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:42.009453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24575): Launched 10:12:42.292063 run iperf3-srv_10.42.42.10(pid=24576): Launched 10:12:42.414721 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:12:42.633638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:42.959102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24577): Launched 10:12:43.244004 run iperf3-srv_10.42.42.10(pid=24578): Launched 10:12:43.366593 tst cs_paging_gprs_active.py:38: start network... 10:12:43.585676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:44.088248 run create_hlr_db(pid=24579): Launched 10:12:44.214345 bus /sierra_2: Setting Powered False 10:12:45.278634 run create_hlr_db(pid=24579): Terminated: ok {rc=0} 10:12:45.710877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24581): Launched 10:12:46.041127 run osmo-hlr_10.42.42.2(pid=24582): Launched 10:12:46.163166 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:46.865881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24584): Launched 10:12:47.187723 run osmo-stp_10.42.42.5(pid=24585): Launched 10:12:47.431737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:47.995342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24587): Launched 10:12:48.122049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:48.397385 run patchelf(pid=24588): Launched 10:12:48.579572 run osmo-stp_10.42.42.5(pid=24585): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24585)] 10:12:48.717835 run osmo-stp_10.42.42.5(pid=24585): stdout: | (launched: 2022-12-09_10:12:47.128881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:48.857183 run osmo-stp_10.42.42.5(pid=24585): stderr: | 20221209101247353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101247353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101247354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101247354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101247355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101247355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101247355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:48.996863 run osmo-stp_10.42.42.5(pid=24585): stdout: | (launched: 2022-12-09_10:12:47.128881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:49.131246 run osmo-stp_10.42.42.5(pid=24585): stderr: | 20221209101247353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101247353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101247354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101247354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101247355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101247355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101247355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:49.290106 run patchelf(pid=24588): Terminating (SIGINT) 10:12:49.472424 run patchelf(pid=24588): Terminated: ok {rc=0} 10:12:49.603841 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24585): Process ended prematurely: osmo-stp_10.42.42.5(pid=24585) [trial-2358↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24585)] [trial-2358↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 10:12:49.614146 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:12:49.643541 run osmo-hlr_10.42.42.2(pid=24582): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24582)] 10:12:49.694498 run osmo-hlr_10.42.42.2(pid=24582): stdout: | (launched: 2022-12-09_10:12:45.979575) 10:12:49.747043 run osmo-hlr_10.42.42.2(pid=24582): stderr: | 20221209101246358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101246358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101246358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101246358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101246358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101246358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101246383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101246404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101246412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101246412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:49.800301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24575): Terminating (SIGTERM) 10:12:49.842876 run iperf3-srv_10.42.42.10(pid=24576): Terminating (SIGTERM) 10:12:49.885714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24577): Terminating (SIGTERM) 10:12:49.928344 run iperf3-srv_10.42.42.10(pid=24578): Terminating (SIGTERM) 10:12:49.970730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24581): Terminating (SIGTERM) 10:12:50.013631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24584): Terminating (SIGTERM) 10:12:50.056318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24587): Terminating (SIGTERM) 10:12:50.099031 --- ParallelTerminationStrategy: PID 24575 died... 10:12:50.119389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24575): Terminated: ok {rc=0} 10:12:50.167156 --- ParallelTerminationStrategy: PID 24576 died... 10:12:50.186833 run iperf3-srv_10.42.42.10(pid=24576): Terminated {rc=256} 10:12:50.233659 --- ParallelTerminationStrategy: PID 24577 died... 10:12:50.253346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24577): Terminated: ok {rc=0} 10:12:50.300264 --- ParallelTerminationStrategy: PID 24578 died... 10:12:50.320079 run iperf3-srv_10.42.42.10(pid=24578): Terminated {rc=256} 10:12:50.366813 --- ParallelTerminationStrategy: PID 24581 died... 10:12:50.386720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24581): Terminated: ok {rc=0} 10:12:50.433857 --- ParallelTerminationStrategy: PID 24584 died... 10:12:50.453470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24584): Terminated: ok {rc=0} 10:12:50.500564 --- ParallelTerminationStrategy: PID 24587 died... 10:12:50.520398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24587): Terminated: ok {rc=0} 10:12:50.609252 bus /gobi_0: Setting Powered False 10:12:51.708908 bus /gobi_0: Setting Powered False 10:12:52.823008 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200 iperf3.py ---------------------------------------------- 10:12:53.965722 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:53.976644 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:12:54.028587 tst iperf3.py: using LAC 20751 10:12:54.152463 tst iperf3.py: using RAC 96 10:12:54.272349 tst iperf3.py: using CellId 20751 10:12:54.400881 tst iperf3.py: using BVCI 20752 10:12:54.519493 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.530688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.541701 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.552773 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.563891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.574861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.586450 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.597421 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:12:54.608672 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:12:54.722655 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:12:54.925221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:55.229609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Launched 10:12:55.494246 run iperf3-srv_10.42.42.10(pid=24590): Launched 10:12:55.608020 tst iperf3.py:8: start network... 10:12:55.809294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:56.276768 run create_hlr_db(pid=24591): Launched 10:12:56.401407 bus /gobi_6: Setting Powered False 10:12:57.461681 run create_hlr_db(pid=24591): Terminated: ok {rc=0} 10:12:57.903032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Launched 10:12:58.227099 run osmo-hlr_10.42.42.2(pid=24594): Launched 10:12:58.353160 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:58.912519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Launched 10:12:59.238011 run osmo-stp_10.42.42.5(pid=24597): Launched 10:12:59.362520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:59.923640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24599): Launched 10:13:00.047588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:00.322114 run patchelf(pid=24600): Launched 10:13:00.503610 run osmo-stp_10.42.42.5(pid=24597): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] 10:13:00.640486 run osmo-stp_10.42.42.5(pid=24597): stdout: | (launched: 2022-12-09_10:12:59.178278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:00.778919 run osmo-stp_10.42.42.5(pid=24597): stderr: | 20221209101259367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101259367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101259367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101259367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101259368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101259368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101259368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:00.945303 run osmo-stp_10.42.42.5(pid=24597): stdout: | (launched: 2022-12-09_10:12:59.178278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:01.083945 run osmo-stp_10.42.42.5(pid=24597): stderr: | 20221209101259367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101259367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101259367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101259367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101259368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101259368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101259368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:01.234920 run patchelf(pid=24600): Terminating (SIGINT) 10:13:01.410585 run patchelf(pid=24600): Terminated: ok {rc=0} 10:13:01.536310 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24597): Process ended prematurely: osmo-stp_10.42.42.5(pid=24597) [trial-2358↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] [trial-2358↪gprs:trx-b200↪iperf3.py:8] 10:13:01.547081 tst iperf3.py:8: Test FAILED (7.6 sec) 10:13:01.576344 run osmo-hlr_10.42.42.2(pid=24594): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24594)] 10:13:01.627531 run osmo-hlr_10.42.42.2(pid=24594): stdout: | (launched: 2022-12-09_10:12:58.168035) 10:13:01.680688 run osmo-hlr_10.42.42.2(pid=24594): stderr: | 20221209101258362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101258362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101258362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101258362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101258362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101258362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101258373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101258382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101258383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101258383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:01.732712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Terminating (SIGTERM) 10:13:01.774700 run iperf3-srv_10.42.42.10(pid=24590): Terminating (SIGTERM) 10:13:01.819896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Terminating (SIGTERM) 10:13:01.864165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Terminating (SIGTERM) 10:13:01.907816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24599): Terminating (SIGTERM) 10:13:01.953503 --- ParallelTerminationStrategy: PID 24589 died... 10:13:01.973624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Terminated: ok {rc=0} 10:13:02.021968 --- ParallelTerminationStrategy: PID 24590 died... 10:13:02.041416 run iperf3-srv_10.42.42.10(pid=24590): Terminated {rc=256} 10:13:02.088017 --- ParallelTerminationStrategy: PID 24593 died... 10:13:02.107483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Terminated: ok {rc=0} 10:13:02.152484 --- ParallelTerminationStrategy: PID 24596 died... 10:13:02.171870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Terminated: ok {rc=0} 10:13:02.218018 --- ParallelTerminationStrategy: PID 24599 died... 10:13:02.237142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24599): Terminated: ok {rc=0} 10:13:02.324159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 10:13:03.474863 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:03.486070 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:13:03.535071 tst iperf3m4.py: using LAC 20752 10:13:03.652748 tst iperf3m4.py: using RAC 97 10:13:03.771460 tst iperf3m4.py: using CellId 20752 10:13:03.891319 tst iperf3m4.py: using BVCI 20753 10:13:04.002272 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.012916 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.023297 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.033659 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.043891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.054146 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.064882 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.075367 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:04.086080 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:13:04.204742 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:13:04.326421 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:13:04.442438 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:13:04.558575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:13:04.760334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:05.064249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24601): Launched 10:13:05.328569 run iperf3-srv_10.42.42.10(pid=24602): Launched 10:13:05.442585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:13:05.642781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:05.945386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24603): Launched 10:13:06.209174 run iperf3-srv_10.42.42.10(pid=24604): Launched 10:13:06.322781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:13:06.523041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:06.826141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24605): Launched 10:13:07.093252 run iperf3-srv_10.42.42.10(pid=24606): Launched 10:13:07.207094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:13:07.407565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:07.711429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24607): Launched 10:13:07.975663 run iperf3-srv_10.42.42.10(pid=24608): Launched 10:13:08.089866 tst iperf3m4.py:8: start network... 10:13:08.291433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:08.760868 run create_hlr_db(pid=24609): Launched 10:13:08.885659 bus /gobi_6: Setting Powered False 10:13:09.946295 run create_hlr_db(pid=24609): Terminated: ok {rc=0} 10:13:10.394911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Launched 10:13:10.722674 run osmo-hlr_10.42.42.2(pid=24612): Launched 10:13:10.849402 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:11.414597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Launched 10:13:11.742611 run osmo-stp_10.42.42.5(pid=24615): Launched 10:13:11.868303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:12.428166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24617): Launched 10:13:12.552915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:12.827969 run patchelf(pid=24618): Launched 10:13:13.011516 run osmo-stp_10.42.42.5(pid=24615): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] 10:13:13.151885 run osmo-stp_10.42.42.5(pid=24615): stdout: | (launched: 2022-12-09_10:13:11.682849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:13.292530 run osmo-stp_10.42.42.5(pid=24615): stderr: | 20221209101311870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101311870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101311871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101311871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101311871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101311871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101311872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:13.434158 run osmo-stp_10.42.42.5(pid=24615): stdout: | (launched: 2022-12-09_10:13:11.682849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:13.570033 run osmo-stp_10.42.42.5(pid=24615): stderr: | 20221209101311870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101311870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101311871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101311871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101311871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101311871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101311872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:13.730797 run patchelf(pid=24618): Terminating (SIGINT) 10:13:13.915158 run patchelf(pid=24618): Terminated: ok {rc=0} 10:13:14.048342 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24615): Process ended prematurely: osmo-stp_10.42.42.5(pid=24615) [trial-2358↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] [trial-2358↪gprs:trx-b200↪iperf3m4.py:8] 10:13:14.059027 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:13:14.089412 run osmo-hlr_10.42.42.2(pid=24612): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24612)] 10:13:14.141150 run osmo-hlr_10.42.42.2(pid=24612): stdout: | (launched: 2022-12-09_10:13:10.663321) 10:13:14.194524 run osmo-hlr_10.42.42.2(pid=24612): stderr: | 20221209101310860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101310860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101310860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101310860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101310860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101310860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101310873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101310882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101310882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101310882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:14.248135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24601): Terminating (SIGTERM) 10:13:14.291403 run iperf3-srv_10.42.42.10(pid=24602): Terminating (SIGTERM) 10:13:14.334442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24603): Terminating (SIGTERM) 10:13:14.377636 run iperf3-srv_10.42.42.10(pid=24604): Terminating (SIGTERM) 10:13:14.420757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24605): Terminating (SIGTERM) 10:13:14.464236 run iperf3-srv_10.42.42.10(pid=24606): Terminating (SIGTERM) 10:13:14.507340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24607): Terminating (SIGTERM) 10:13:14.550485 run iperf3-srv_10.42.42.10(pid=24608): Terminating (SIGTERM) 10:13:14.593383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Terminating (SIGTERM) 10:13:14.636164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Terminating (SIGTERM) 10:13:14.679225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24617): Terminating (SIGTERM) 10:13:14.722518 --- ParallelTerminationStrategy: PID 24601 died... 10:13:14.743008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24601): Terminated: ok {rc=0} 10:13:14.790840 --- ParallelTerminationStrategy: PID 24602 died... 10:13:14.810797 run iperf3-srv_10.42.42.10(pid=24602): Terminated {rc=256} 10:13:14.858176 --- ParallelTerminationStrategy: PID 24603 died... 10:13:14.878101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24603): Terminated: ok {rc=0} 10:13:14.925310 --- ParallelTerminationStrategy: PID 24604 died... 10:13:14.945035 run iperf3-srv_10.42.42.10(pid=24604): Terminated {rc=256} 10:13:14.991790 --- ParallelTerminationStrategy: PID 24605 died... 10:13:15.011578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24605): Terminated: ok {rc=0} 10:13:15.058779 --- ParallelTerminationStrategy: PID 24606 died... 10:13:15.078647 run iperf3-srv_10.42.42.10(pid=24606): Terminated {rc=256} 10:13:15.125830 --- ParallelTerminationStrategy: PID 24607 died... 10:13:15.145571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24607): Terminated: ok {rc=0} 10:13:15.192685 --- ParallelTerminationStrategy: PID 24608 died... 10:13:15.212548 run iperf3-srv_10.42.42.10(pid=24608): Terminated {rc=256} 10:13:15.259539 --- ParallelTerminationStrategy: PID 24611 died... 10:13:15.279402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Terminated: ok {rc=0} 10:13:15.326413 --- ParallelTerminationStrategy: PID 24614 died... 10:13:15.346450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Terminated: ok {rc=0} 10:13:15.393547 --- ParallelTerminationStrategy: PID 24617 died... 10:13:15.413414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24617): Terminated: ok {rc=0} 10:13:15.503033 bus /gobi_4: Setting Powered False 10:13:16.607258 bus /gobi_4: Setting Powered False 10:13:17.733700 bus /gobi_1: Setting Powered False 10:13:18.831969 bus /gobi_1: Setting Powered False 10:13:19.949281 bus /gobi_0: Setting Powered False 10:13:21.048019 bus /gobi_0: Setting Powered False 10:13:22.166029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200 ping.py ---------------------------------------------- 10:13:23.270089 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.281986 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:13:23.336267 tst ping.py: using LAC 20753 10:13:23.465081 tst ping.py: using RAC 98 10:13:23.590340 tst ping.py: using CellId 20753 10:13:23.719902 tst ping.py: using BVCI 20754 10:13:23.839117 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.850204 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.861127 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.872229 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.883246 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.894363 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.905565 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:23.916780 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:13:24.031506 tst ping.py:19: start network... 10:13:24.233371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:24.701740 run create_hlr_db(pid=24619): Launched 10:13:24.827239 bus /gobi_6: Setting Powered False 10:13:25.887316 run create_hlr_db(pid=24619): Terminated: ok {rc=0} 10:13:26.330290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24621): Launched 10:13:26.656749 run osmo-hlr_10.42.42.2(pid=24622): Launched 10:13:26.781653 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:27.346413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24624): Launched 10:13:27.672288 run osmo-stp_10.42.42.5(pid=24625): Launched 10:13:27.797080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:28.352238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24627): Launched 10:13:28.476365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:28.749090 run patchelf(pid=24628): Launched 10:13:28.931185 run osmo-stp_10.42.42.5(pid=24625): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24625)] 10:13:29.068118 run osmo-stp_10.42.42.5(pid=24625): stdout: | (launched: 2022-12-09_10:13:27.612458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:29.205969 run osmo-stp_10.42.42.5(pid=24625): stderr: | 20221209101327805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101327805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101327806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101327806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101327806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101327807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101327807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:29.344078 run osmo-stp_10.42.42.5(pid=24625): stdout: | (launched: 2022-12-09_10:13:27.612458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:29.476482 run osmo-stp_10.42.42.5(pid=24625): stderr: | 20221209101327805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101327805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101327806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101327806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101327806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101327807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101327807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:29.633575 run patchelf(pid=24628): Terminating (SIGINT) 10:13:29.813604 run patchelf(pid=24628): Terminated: ok {rc=0} 10:13:29.943411 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24625): Process ended prematurely: osmo-stp_10.42.42.5(pid=24625) [trial-2358↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24625)] [trial-2358↪gprs:trx-b200↪ping.py:22] 10:13:29.953099 tst ping.py:22: Test FAILED (6.7 sec) 10:13:29.982434 run osmo-hlr_10.42.42.2(pid=24622): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24622)] 10:13:30.033828 run osmo-hlr_10.42.42.2(pid=24622): stdout: | (launched: 2022-12-09_10:13:26.597212) 10:13:30.086747 run osmo-hlr_10.42.42.2(pid=24622): stderr: | 20221209101326795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101326795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101326795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101326795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101326795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101326795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101326811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101326821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101326822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101326822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:30.140149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24621): Terminating (SIGTERM) 10:13:30.183213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24624): Terminating (SIGTERM) 10:13:30.226298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24627): Terminating (SIGTERM) 10:13:30.269231 --- ParallelTerminationStrategy: PID 24621 died... 10:13:30.289601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24621): Terminated: ok {rc=0} 10:13:30.337231 --- ParallelTerminationStrategy: PID 24624 died... 10:13:30.357345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24624): Terminated: ok {rc=0} 10:13:30.404705 --- ParallelTerminationStrategy: PID 24627 died... 10:13:30.424695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24627): Terminated: ok {rc=0} 10:13:30.515438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 10:13:31.605144 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:31.617436 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:13:31.668932 tst ping_idle_ping.py: using LAC 20754 10:13:31.794014 tst ping_idle_ping.py: using RAC 99 10:13:31.929873 tst ping_idle_ping.py: using CellId 20754 10:13:32.053560 tst ping_idle_ping.py: using BVCI 20755 10:13:32.194709 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.205946 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.216843 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.228158 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.239346 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.250390 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.262568 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:13:32.273804 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:13:32.391678 tst ping_idle_ping.py:24: start network... 10:13:32.593147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:33.064128 run create_hlr_db(pid=24629): Launched 10:13:33.189806 bus /gobi_6: Setting Powered False 10:13:34.249934 run create_hlr_db(pid=24629): Terminated: ok {rc=0} 10:13:34.693257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24631): Launched 10:13:35.018891 run osmo-hlr_10.42.42.2(pid=24632): Launched 10:13:35.143967 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:35.706373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24634): Launched 10:13:36.030856 run osmo-stp_10.42.42.5(pid=24635): Launched 10:13:36.155743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:36.714515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24637): Launched 10:13:36.839039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:37.112422 run patchelf(pid=24638): Launched 10:13:37.293683 run osmo-stp_10.42.42.5(pid=24635): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24635)] 10:13:37.431473 run osmo-stp_10.42.42.5(pid=24635): stdout: | (launched: 2022-12-09_10:13:35.970990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:37.571006 run osmo-stp_10.42.42.5(pid=24635): stderr: | 20221209101336162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101336163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101336163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101336163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101336164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101336164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101336164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:37.709914 run osmo-stp_10.42.42.5(pid=24635): stdout: | (launched: 2022-12-09_10:13:35.970990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:37.843055 run osmo-stp_10.42.42.5(pid=24635): stderr: | 20221209101336162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101336163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101336163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101336163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101336164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101336164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101336164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:38.000689 run patchelf(pid=24638): Terminating (SIGINT) 10:13:38.182335 run patchelf(pid=24638): Terminated: ok {rc=0} 10:13:38.313163 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24635): Process ended prematurely: osmo-stp_10.42.42.5(pid=24635) [trial-2358↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24635)] [trial-2358↪gprs:trx-b200↪ping_idle_ping.py:27] 10:13:38.322897 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:13:38.352321 run osmo-hlr_10.42.42.2(pid=24632): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24632)] 10:13:38.403745 run osmo-hlr_10.42.42.2(pid=24632): stdout: | (launched: 2022-12-09_10:13:34.959160) 10:13:38.457225 run osmo-hlr_10.42.42.2(pid=24632): stderr: | 20221209101335158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101335158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101335158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101335158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101335158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101335158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101335171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101335179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101335180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101335180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:38.510820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24631): Terminating (SIGTERM) 10:13:38.553889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24634): Terminating (SIGTERM) 10:13:38.596879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24637): Terminating (SIGTERM) 10:13:38.640237 --- ParallelTerminationStrategy: PID 24631 died... 10:13:38.660570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24631): Terminated: ok {rc=0} 10:13:38.708184 --- ParallelTerminationStrategy: PID 24634 died... 10:13:38.728057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24634): Terminated: ok {rc=0} 10:13:38.775380 --- ParallelTerminationStrategy: PID 24637 died... 10:13:38.795234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24637): Terminated: ok {rc=0} 10:13:38.885546 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 10:13:40.192605 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:13:40.198159 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:13:40.231198 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:13:40.269255 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:13:40.355216 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:13:40.387737 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:13:40.425658 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:13:41.017884 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:13:41.067968 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.078917 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:13:41.129152 tst cs_paging_gprs_active.py: using LAC 20755 10:13:41.251518 tst cs_paging_gprs_active.py: using RAC 100 10:13:41.379958 tst cs_paging_gprs_active.py: using CellId 20755 10:13:41.509828 tst cs_paging_gprs_active.py: using BVCI 20756 10:13:41.631639 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.642974 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.654010 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.665683 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.676829 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.688074 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.699546 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.710774 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:41.722154 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:13:41.839480 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:13:41.956667 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:13:42.162532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:42.470851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24642): Launched 10:13:42.739882 run iperf3-srv_10.42.42.10(pid=24643): Launched 10:13:42.855809 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:13:43.060594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:43.370515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24644): Launched 10:13:43.641205 run iperf3-srv_10.42.42.10(pid=24645): Launched 10:13:43.757422 tst cs_paging_gprs_active.py:38: start network... 10:13:43.963133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:44.441424 run create_hlr_db(pid=24646): Launched 10:13:44.569324 bus /gobi_6: Setting Powered False 10:13:45.629897 run create_hlr_db(pid=24646): Terminated: ok {rc=0} 10:13:46.076611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24648): Launched 10:13:46.433761 run osmo-hlr_10.42.42.2(pid=24649): Launched 10:13:46.694658 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:47.356775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24651): Launched 10:13:47.688060 run osmo-stp_10.42.42.5(pid=24652): Launched 10:13:47.815865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:48.383055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24654): Launched 10:13:48.511779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:48.790240 run patchelf(pid=24655): Launched 10:13:48.974921 run osmo-stp_10.42.42.5(pid=24652): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24652)] 10:13:49.114073 run osmo-stp_10.42.42.5(pid=24652): stdout: | (launched: 2022-12-09_10:13:47.627427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:49.254628 run osmo-stp_10.42.42.5(pid=24652): stderr: | 20221209101347815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101347815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101347816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101347816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101347817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101347817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101347817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:49.395496 run osmo-stp_10.42.42.5(pid=24652): stdout: | (launched: 2022-12-09_10:13:47.627427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:49.531335 run osmo-stp_10.42.42.5(pid=24652): stderr: | 20221209101347815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101347815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101347816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101347816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101347817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101347817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101347817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:49.691698 run patchelf(pid=24655): Terminating (SIGINT) 10:13:49.875916 run patchelf(pid=24655): Terminated: ok {rc=0} 10:13:50.009147 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24652): Process ended prematurely: osmo-stp_10.42.42.5(pid=24652) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24652)] [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:13:50.019496 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:13:50.049150 run osmo-hlr_10.42.42.2(pid=24649): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24649)] 10:13:50.099782 run osmo-hlr_10.42.42.2(pid=24649): stdout: | (launched: 2022-12-09_10:13:46.368738) 10:13:50.152443 run osmo-hlr_10.42.42.2(pid=24649): stderr: | 20221209101346662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101346662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101346662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101346662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101346662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101346662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101346684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101346697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101346697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101346697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:50.205569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24642): Terminating (SIGTERM) 10:13:50.248085 run iperf3-srv_10.42.42.10(pid=24643): Terminating (SIGTERM) 10:13:50.290706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24644): Terminating (SIGTERM) 10:13:50.333273 run iperf3-srv_10.42.42.10(pid=24645): Terminating (SIGTERM) 10:13:50.375749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24648): Terminating (SIGTERM) 10:13:50.418273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24651): Terminating (SIGTERM) 10:13:50.460757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24654): Terminating (SIGTERM) 10:13:50.503707 --- ParallelTerminationStrategy: PID 24642 died... 10:13:50.523966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24642): Terminated: ok {rc=0} 10:13:50.571378 --- ParallelTerminationStrategy: PID 24643 died... 10:13:50.591048 run iperf3-srv_10.42.42.10(pid=24643): Terminated {rc=256} 10:13:50.637713 --- ParallelTerminationStrategy: PID 24644 died... 10:13:50.657302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24644): Terminated: ok {rc=0} 10:13:50.704038 --- ParallelTerminationStrategy: PID 24645 died... 10:13:50.723507 run iperf3-srv_10.42.42.10(pid=24645): Terminated {rc=256} 10:13:50.770004 --- ParallelTerminationStrategy: PID 24648 died... 10:13:50.789562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24648): Terminated: ok {rc=0} 10:13:50.836207 --- ParallelTerminationStrategy: PID 24651 died... 10:13:50.855963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24651): Terminated: ok {rc=0} 10:13:50.902696 --- ParallelTerminationStrategy: PID 24654 died... 10:13:50.922395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24654): Terminated: ok {rc=0} 10:13:51.011461 bus /gobi_0: Setting Powered False 10:13:52.111778 bus /gobi_0: Setting Powered False 10:13:53.229125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:13:54.381446 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:54.393496 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:13:54.449248 tst iperf3.py: using LAC 20756 10:13:54.579365 tst iperf3.py: using RAC 101 10:13:54.708906 tst iperf3.py: using CellId 20756 10:13:54.843408 tst iperf3.py: using BVCI 20757 10:13:54.963971 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:54.975324 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:54.986548 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:54.997931 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:55.009225 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:55.020480 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:55.032217 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:55.043668 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:13:55.055197 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:13:55.172372 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:13:55.378081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:55.688056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24656): Launched 10:13:55.957104 run iperf3-srv_10.42.42.10(pid=24657): Launched 10:13:56.072563 tst iperf3.py:8: start network... 10:13:56.277540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:56.756469 run create_hlr_db(pid=24658): Launched 10:13:56.883306 bus /gobi_6: Setting Powered False 10:13:57.944345 run create_hlr_db(pid=24658): Terminated: ok {rc=0} 10:13:58.391619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24660): Launched 10:13:58.722638 run osmo-hlr_10.42.42.2(pid=24661): Launched 10:13:58.850108 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:59.415024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24663): Launched 10:13:59.745400 run osmo-stp_10.42.42.5(pid=24664): Launched 10:13:59.871568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:00.442242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24666): Launched 10:14:00.568650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:00.857827 run patchelf(pid=24667): Launched 10:14:01.044523 run osmo-stp_10.42.42.5(pid=24664): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24664)] 10:14:01.179132 run osmo-stp_10.42.42.5(pid=24664): stdout: | (launched: 2022-12-09_10:13:59.683981) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:01.314246 run osmo-stp_10.42.42.5(pid=24664): stderr: | 20221209101359875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101359875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101359876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101359876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101359876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101359877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101359877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:01.449824 run osmo-stp_10.42.42.5(pid=24664): stdout: | (launched: 2022-12-09_10:13:59.683981) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:01.620472 run osmo-stp_10.42.42.5(pid=24664): stderr: | 20221209101359875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101359875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101359876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101359876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101359876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101359877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101359877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:01.810845 run patchelf(pid=24667): Terminating (SIGINT) 10:14:01.989580 run patchelf(pid=24667): Terminated: ok {rc=0} 10:14:02.120532 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24664): Process ended prematurely: osmo-stp_10.42.42.5(pid=24664) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24664)] [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 10:14:02.131406 tst iperf3.py:8: Test FAILED (7.8 sec) 10:14:02.161921 run osmo-hlr_10.42.42.2(pid=24661): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24661)] 10:14:02.212866 run osmo-hlr_10.42.42.2(pid=24661): stdout: | (launched: 2022-12-09_10:13:58.662259) 10:14:02.263884 run osmo-hlr_10.42.42.2(pid=24661): stderr: | 20221209101358858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101358858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101358858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101358858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101358858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101358858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101358871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101358882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101358882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101358882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:02.316049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24656): Terminating (SIGTERM) 10:14:02.356837 run iperf3-srv_10.42.42.10(pid=24657): Terminating (SIGTERM) 10:14:02.397249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24660): Terminating (SIGTERM) 10:14:02.437996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24663): Terminating (SIGTERM) 10:14:02.479238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24666): Terminating (SIGTERM) 10:14:02.519657 --- ParallelTerminationStrategy: PID 24656 died... 10:14:02.538630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24656): Terminated: ok {rc=0} 10:14:02.583304 --- ParallelTerminationStrategy: PID 24657 died... 10:14:02.602059 run iperf3-srv_10.42.42.10(pid=24657): Terminated {rc=256} 10:14:02.646091 --- ParallelTerminationStrategy: PID 24660 died... 10:14:02.665031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24660): Terminated: ok {rc=0} 10:14:02.709325 --- ParallelTerminationStrategy: PID 24663 died... 10:14:02.728071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24663): Terminated: ok {rc=0} 10:14:02.772473 --- ParallelTerminationStrategy: PID 24666 died... 10:14:02.791496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24666): Terminated: ok {rc=0} 10:14:02.878097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:14:04.029992 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.042131 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:14:04.095165 tst iperf3m4.py: using LAC 20757 10:14:04.224779 tst iperf3m4.py: using RAC 102 10:14:04.354041 tst iperf3m4.py: using CellId 20757 10:14:04.482441 tst iperf3m4.py: using BVCI 20758 10:14:04.604362 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.615895 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.626956 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.638438 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.649751 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.661202 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.672798 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.684179 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:04.695698 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:14:04.812894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:14:04.930435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:14:05.050072 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:14:05.167738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:14:05.372887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:05.681538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24668): Launched 10:14:05.951910 run iperf3-srv_10.42.42.10(pid=24669): Launched 10:14:06.067308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:14:06.271751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:06.579604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24670): Launched 10:14:06.849815 run iperf3-srv_10.42.42.10(pid=24671): Launched 10:14:06.965327 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:14:07.170126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:07.478417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24672): Launched 10:14:07.746349 run iperf3-srv_10.42.42.10(pid=24673): Launched 10:14:07.861598 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:14:08.064762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:08.371970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24674): Launched 10:14:08.639594 run iperf3-srv_10.42.42.10(pid=24675): Launched 10:14:08.754157 tst iperf3m4.py:8: start network... 10:14:08.957684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:09.435315 run create_hlr_db(pid=24676): Launched 10:14:09.565331 bus /gobi_6: Setting Powered False 10:14:10.626350 run create_hlr_db(pid=24676): Terminated: ok {rc=0} 10:14:11.053101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Launched 10:14:11.360783 run osmo-hlr_10.42.42.2(pid=24679): Launched 10:14:11.477153 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:12.005341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Launched 10:14:12.312686 run osmo-stp_10.42.42.5(pid=24682): Launched 10:14:12.429989 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:12.962641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24684): Launched 10:14:13.081971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:13.341563 run patchelf(pid=24685): Launched 10:14:13.513167 run osmo-stp_10.42.42.5(pid=24682): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] 10:14:13.643277 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-09_10:14:12.255583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:13.774389 run osmo-stp_10.42.42.5(pid=24682): stderr: | 20221209101412424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101412424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101412424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101412425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101412425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101412425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101412425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:13.905540 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-09_10:14:12.255583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:14.030988 run osmo-stp_10.42.42.5(pid=24682): stderr: | 20221209101412424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101412424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101412424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101412425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101412425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101412425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101412425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:14.180590 run patchelf(pid=24685): Terminating (SIGINT) 10:14:14.352293 run patchelf(pid=24685): Terminated: ok {rc=0} 10:14:14.476229 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 10:14:14.485938 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:14:14.513925 run osmo-hlr_10.42.42.2(pid=24679): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24679)] 10:14:14.561834 run osmo-hlr_10.42.42.2(pid=24679): stdout: | (launched: 2022-12-09_10:14:11.303670) 10:14:14.611746 run osmo-hlr_10.42.42.2(pid=24679): stderr: | 20221209101411480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101411480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101411480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101411480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101411480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101411480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101411492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101411501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101411501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101411501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:14.661505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24668): Terminating (SIGTERM) 10:14:14.701407 run iperf3-srv_10.42.42.10(pid=24669): Terminating (SIGTERM) 10:14:14.741102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24670): Terminating (SIGTERM) 10:14:14.781147 run iperf3-srv_10.42.42.10(pid=24671): Terminating (SIGTERM) 10:14:14.820938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24672): Terminating (SIGTERM) 10:14:14.861125 run iperf3-srv_10.42.42.10(pid=24673): Terminating (SIGTERM) 10:14:14.900994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24674): Terminating (SIGTERM) 10:14:14.940769 run iperf3-srv_10.42.42.10(pid=24675): Terminating (SIGTERM) 10:14:14.980401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminating (SIGTERM) 10:14:15.020397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminating (SIGTERM) 10:14:15.060510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24684): Terminating (SIGTERM) 10:14:15.100815 --- ParallelTerminationStrategy: PID 24668 died... 10:14:15.120141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24668): Terminated: ok {rc=0} 10:14:15.165035 --- ParallelTerminationStrategy: PID 24669 died... 10:14:15.183740 run iperf3-srv_10.42.42.10(pid=24669): Terminated {rc=256} 10:14:15.227758 --- ParallelTerminationStrategy: PID 24670 died... 10:14:15.246598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24670): Terminated: ok {rc=0} 10:14:15.291148 --- ParallelTerminationStrategy: PID 24671 died... 10:14:15.309960 run iperf3-srv_10.42.42.10(pid=24671): Terminated {rc=256} 10:14:15.354562 --- ParallelTerminationStrategy: PID 24672 died... 10:14:15.373370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24672): Terminated: ok {rc=0} 10:14:15.417745 --- ParallelTerminationStrategy: PID 24673 died... 10:14:15.436494 run iperf3-srv_10.42.42.10(pid=24673): Terminated {rc=256} 10:14:15.480711 --- ParallelTerminationStrategy: PID 24674 died... 10:14:15.499585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24674): Terminated: ok {rc=0} 10:14:15.543863 --- ParallelTerminationStrategy: PID 24675 died... 10:14:15.563065 run iperf3-srv_10.42.42.10(pid=24675): Terminated {rc=256} 10:14:15.607617 --- ParallelTerminationStrategy: PID 24678 died... 10:14:15.626482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminated: ok {rc=0} 10:14:15.670931 --- ParallelTerminationStrategy: PID 24681 died... 10:14:15.689815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminated: ok {rc=0} 10:14:15.734057 --- ParallelTerminationStrategy: PID 24684 died... 10:14:15.753023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24684): Terminated: ok {rc=0} 10:14:15.860882 bus /gobi_4: Setting Powered False 10:14:16.994239 bus /gobi_4: Setting Powered False 10:14:18.124592 bus /gobi_1: Setting Powered False 10:14:19.226359 bus /gobi_1: Setting Powered False 10:14:20.343711 bus /gobi_0: Setting Powered False 10:14:21.444842 bus /gobi_0: Setting Powered False 10:14:22.563768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 10:14:23.669983 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:23.681402 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:14:23.732465 tst ping.py: using LAC 20758 10:14:23.852320 tst ping.py: using RAC 103 10:14:23.971919 tst ping.py: using CellId 20758 10:14:24.089249 tst ping.py: using BVCI 20759 10:14:24.198153 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.208937 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.219560 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.230191 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.240607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.251141 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.261877 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:24.272358 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:14:24.387760 tst ping.py:19: start network... 10:14:24.587178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:25.055584 run create_hlr_db(pid=24687): Launched 10:14:25.180176 bus /gobi_6: Setting Powered False 10:14:26.241338 run create_hlr_db(pid=24687): Terminated: ok {rc=0} 10:14:26.683794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Launched 10:14:27.007164 run osmo-hlr_10.42.42.2(pid=24690): Launched 10:14:27.132556 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:27.698668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Launched 10:14:28.024258 run osmo-stp_10.42.42.5(pid=24693): Launched 10:14:28.147722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:28.706995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24695): Launched 10:14:28.833753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:29.107294 run patchelf(pid=24696): Launched 10:14:29.287745 run osmo-stp_10.42.42.5(pid=24693): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] 10:14:29.426064 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-09_10:14:27.964147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:29.565842 run osmo-stp_10.42.42.5(pid=24693): stderr: | 20221209101428156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101428156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101428157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101428157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101428158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101428158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101428158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:29.704358 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-09_10:14:27.964147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:29.838427 run osmo-stp_10.42.42.5(pid=24693): stderr: | 20221209101428156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101428156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101428157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101428157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101428158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101428158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101428158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:29.996081 run patchelf(pid=24696): Terminating (SIGINT) 10:14:30.177732 run patchelf(pid=24696): Terminated: ok {rc=0} 10:14:30.308365 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 10:14:30.318259 tst ping.py:22: Test FAILED (6.6 sec) 10:14:30.347960 run osmo-hlr_10.42.42.2(pid=24690): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24690)] 10:14:30.399806 run osmo-hlr_10.42.42.2(pid=24690): stdout: | (launched: 2022-12-09_10:14:26.947319) 10:14:30.453432 run osmo-hlr_10.42.42.2(pid=24690): stderr: | 20221209101427145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101427145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101427145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101427146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101427146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101427146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101427158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101427167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101427167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101427167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:30.507836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminating (SIGTERM) 10:14:30.551626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminating (SIGTERM) 10:14:30.595275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24695): Terminating (SIGTERM) 10:14:30.638683 --- ParallelTerminationStrategy: PID 24689 died... 10:14:30.659228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminated: ok {rc=0} 10:14:30.707068 --- ParallelTerminationStrategy: PID 24692 died... 10:14:30.727067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminated: ok {rc=0} 10:14:30.774585 --- ParallelTerminationStrategy: PID 24695 died... 10:14:30.794541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24695): Terminated: ok {rc=0} 10:14:30.895275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:14:31.986939 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.001271 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:14:32.054873 tst ping_idle_ping.py: using LAC 20759 10:14:32.203704 tst ping_idle_ping.py: using RAC 104 10:14:32.323867 tst ping_idle_ping.py: using CellId 20759 10:14:32.444082 tst ping_idle_ping.py: using BVCI 20760 10:14:32.553720 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.564658 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.575433 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.586848 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.597843 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.608672 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.619841 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:14:32.630769 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:14:32.749790 tst ping_idle_ping.py:24: start network... 10:14:32.967254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:33.471718 run create_hlr_db(pid=24697): Launched 10:14:33.598052 bus /gobi_6: Setting Powered False 10:14:34.662509 run create_hlr_db(pid=24697): Terminated: ok {rc=0} 10:14:35.095491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24699): Launched 10:14:35.401604 run osmo-hlr_10.42.42.2(pid=24700): Launched 10:14:35.517549 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:36.042258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24702): Launched 10:14:36.346364 run osmo-stp_10.42.42.5(pid=24703): Launched 10:14:36.464326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:36.987562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24705): Launched 10:14:37.103640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:37.358990 run patchelf(pid=24706): Launched 10:14:37.528166 run osmo-stp_10.42.42.5(pid=24703): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24703)] 10:14:37.656330 run osmo-stp_10.42.42.5(pid=24703): stdout: | (launched: 2022-12-09_10:14:36.289656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:37.786325 run osmo-stp_10.42.42.5(pid=24703): stderr: | 20221209101436459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101436460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101436460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101436461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101436461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101436461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101436461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:37.915717 run osmo-stp_10.42.42.5(pid=24703): stdout: | (launched: 2022-12-09_10:14:36.289656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:38.039780 run osmo-stp_10.42.42.5(pid=24703): stderr: | 20221209101436459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101436460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101436460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101436461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101436461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101436461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101436461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:38.186728 run patchelf(pid=24706): Terminating (SIGINT) 10:14:38.356451 run patchelf(pid=24706): Terminated: ok {rc=0} 10:14:38.479209 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24703): Process ended prematurely: osmo-stp_10.42.42.5(pid=24703) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24703)] [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 10:14:38.488203 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:14:38.515727 run osmo-hlr_10.42.42.2(pid=24700): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24700)] 10:14:38.563971 run osmo-hlr_10.42.42.2(pid=24700): stdout: | (launched: 2022-12-09_10:14:35.345222) 10:14:38.614036 run osmo-hlr_10.42.42.2(pid=24700): stderr: | 20221209101435523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101435523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101435523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101435523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101435523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101435523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101435535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101435544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101435544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101435544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:38.665210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24699): Terminating (SIGTERM) 10:14:38.705656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24702): Terminating (SIGTERM) 10:14:38.746358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24705): Terminating (SIGTERM) 10:14:38.787368 --- ParallelTerminationStrategy: PID 24699 died... 10:14:38.807032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24699): Terminated: ok {rc=0} 10:14:38.852519 --- ParallelTerminationStrategy: PID 24702 died... 10:14:38.871714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24702): Terminated: ok {rc=0} 10:14:38.916739 --- ParallelTerminationStrategy: PID 24705 died... 10:14:38.935951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24705): Terminated: ok {rc=0} 10:14:39.021662 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:14:40.335551 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:14:40.342619 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:14:40.379641 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:14:40.417686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:14:40.504550 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:14:40.537266 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:14:40.575188 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:14:41.167904 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:14:41.218142 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.229160 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:14:41.298407 tst cs_paging_gprs_active.py: using LAC 20760 10:14:41.420582 tst cs_paging_gprs_active.py: using RAC 105 10:14:41.543144 tst cs_paging_gprs_active.py: using CellId 20760 10:14:41.665459 tst cs_paging_gprs_active.py: using BVCI 20761 10:14:41.777792 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.788658 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.799403 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.810377 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.821109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.831889 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.842838 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.853639 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:41.864504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:14:41.985991 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:14:42.103032 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:14:42.311147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:42.621762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24710): Launched 10:14:42.893085 run iperf3-srv_10.42.42.10(pid=24711): Launched 10:14:43.009030 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:14:43.214720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:43.523460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24712): Launched 10:14:43.792026 run iperf3-srv_10.42.42.10(pid=24713): Launched 10:14:43.908213 tst cs_paging_gprs_active.py:38: start network... 10:14:44.113380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:44.593633 run create_hlr_db(pid=24714): Launched 10:14:44.720560 bus /gobi_6: Setting Powered False 10:14:45.781590 run create_hlr_db(pid=24714): Terminated: ok {rc=0} 10:14:46.217116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24716): Launched 10:14:46.565570 run osmo-hlr_10.42.42.2(pid=24717): Launched 10:14:46.780446 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:47.446223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24719): Launched 10:14:47.754638 run osmo-stp_10.42.42.5(pid=24720): Launched 10:14:47.875379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:48.408466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24722): Launched 10:14:48.526417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:48.786473 run patchelf(pid=24723): Launched 10:14:48.959462 run osmo-stp_10.42.42.5(pid=24720): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24720)] 10:14:49.089206 run osmo-stp_10.42.42.5(pid=24720): stdout: | (launched: 2022-12-09_10:14:47.697498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:49.220404 run osmo-stp_10.42.42.5(pid=24720): stderr: | 20221209101447867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101447867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101447867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101447867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101447868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101447868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101447868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:49.351493 run osmo-stp_10.42.42.5(pid=24720): stdout: | (launched: 2022-12-09_10:14:47.697498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:49.477394 run osmo-stp_10.42.42.5(pid=24720): stderr: | 20221209101447867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101447867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101447867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101447867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101447868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101447868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101447868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:49.626874 run patchelf(pid=24723): Terminating (SIGINT) 10:14:49.798559 run patchelf(pid=24723): Terminated: ok {rc=0} 10:14:49.923521 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24720): Process ended prematurely: osmo-stp_10.42.42.5(pid=24720) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24720)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:14:49.933140 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:14:49.960694 run osmo-hlr_10.42.42.2(pid=24717): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24717)] 10:14:50.008479 run osmo-hlr_10.42.42.2(pid=24717): stdout: | (launched: 2022-12-09_10:14:46.504104) 10:14:50.058290 run osmo-hlr_10.42.42.2(pid=24717): stderr: | 20221209101446797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101446797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101446797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101446797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101446797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101446797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101446815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101446828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101446828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101446828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:50.108531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24710): Terminating (SIGTERM) 10:14:50.149170 run iperf3-srv_10.42.42.10(pid=24711): Terminating (SIGTERM) 10:14:50.189418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24712): Terminating (SIGTERM) 10:14:50.229644 run iperf3-srv_10.42.42.10(pid=24713): Terminating (SIGTERM) 10:14:50.269629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24716): Terminating (SIGTERM) 10:14:50.309687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24719): Terminating (SIGTERM) 10:14:50.349946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24722): Terminating (SIGTERM) 10:14:50.390169 --- ParallelTerminationStrategy: PID 24710 died... 10:14:50.409487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24710): Terminated: ok {rc=0} 10:14:50.453872 --- ParallelTerminationStrategy: PID 24711 died... 10:14:50.472437 run iperf3-srv_10.42.42.10(pid=24711): Terminated {rc=256} 10:14:50.516256 --- ParallelTerminationStrategy: PID 24712 died... 10:14:50.535077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24712): Terminated: ok {rc=0} 10:14:50.579199 --- ParallelTerminationStrategy: PID 24713 died... 10:14:50.597905 run iperf3-srv_10.42.42.10(pid=24713): Terminated {rc=256} 10:14:50.641928 --- ParallelTerminationStrategy: PID 24716 died... 10:14:50.660623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24716): Terminated: ok {rc=0} 10:14:50.705069 --- ParallelTerminationStrategy: PID 24719 died... 10:14:50.723756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24719): Terminated: ok {rc=0} 10:14:50.767678 --- ParallelTerminationStrategy: PID 24722 died... 10:14:50.786521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24722): Terminated: ok {rc=0} 10:14:50.872026 bus /gobi_0: Setting Powered False 10:14:51.973957 bus /gobi_0: Setting Powered False 10:14:53.091267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:14:54.243167 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.255200 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:14:54.329941 tst iperf3.py: using LAC 20761 10:14:54.459550 tst iperf3.py: using RAC 106 10:14:54.593812 tst iperf3.py: using CellId 20761 10:14:54.712792 tst iperf3.py: using BVCI 20762 10:14:54.833255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.844522 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.855902 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.867355 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.878675 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.890127 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.901459 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.912718 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:14:54.924309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:14:55.040689 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:14:55.246096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:55.555915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24724): Launched 10:14:55.827180 run iperf3-srv_10.42.42.10(pid=24725): Launched 10:14:55.945136 tst iperf3.py:8: start network... 10:14:56.149761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:56.626697 run create_hlr_db(pid=24726): Launched 10:14:56.755137 bus /gobi_6: Setting Powered False 10:14:57.815819 run create_hlr_db(pid=24726): Terminated: ok {rc=0} 10:14:58.265011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24728): Launched 10:14:58.594503 run osmo-hlr_10.42.42.2(pid=24729): Launched 10:14:58.721790 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:59.287264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24731): Launched 10:14:59.618537 run osmo-stp_10.42.42.5(pid=24732): Launched 10:14:59.746182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:00.315500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24734): Launched 10:15:00.443853 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:00.723194 run patchelf(pid=24735): Launched 10:15:00.909678 run osmo-stp_10.42.42.5(pid=24732): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24732)] 10:15:01.043597 run osmo-stp_10.42.42.5(pid=24732): stdout: | (launched: 2022-12-09_10:14:59.558121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:01.180601 run osmo-stp_10.42.42.5(pid=24732): stderr: | 20221209101459752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101459752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101459752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101459753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101459753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101459753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101459753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:01.316815 run osmo-stp_10.42.42.5(pid=24732): stdout: | (launched: 2022-12-09_10:14:59.558121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:01.446675 run osmo-stp_10.42.42.5(pid=24732): stderr: | 20221209101459752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101459752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101459752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101459753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101459753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101459753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101459753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:01.626057 run patchelf(pid=24735): Terminating (SIGINT) 10:15:01.819172 run patchelf(pid=24735): Terminated: ok {rc=0} 10:15:01.948430 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24732): Process ended prematurely: osmo-stp_10.42.42.5(pid=24732) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24732)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 10:15:01.959234 tst iperf3.py:8: Test FAILED (7.8 sec) 10:15:01.988549 run osmo-hlr_10.42.42.2(pid=24729): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24729)] 10:15:02.038855 run osmo-hlr_10.42.42.2(pid=24729): stdout: | (launched: 2022-12-09_10:14:58.533983) 10:15:02.092130 run osmo-hlr_10.42.42.2(pid=24729): stderr: | 20221209101458734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101458734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101458734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101458734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101458734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101458734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101458746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101458754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101458754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101458754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:02.146334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24724): Terminating (SIGTERM) 10:15:02.188456 run iperf3-srv_10.42.42.10(pid=24725): Terminating (SIGTERM) 10:15:02.230734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24728): Terminating (SIGTERM) 10:15:02.274082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24731): Terminating (SIGTERM) 10:15:02.317927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24734): Terminating (SIGTERM) 10:15:02.362800 --- ParallelTerminationStrategy: PID 24724 died... 10:15:02.382928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24724): Terminated: ok {rc=0} 10:15:02.432070 --- ParallelTerminationStrategy: PID 24725 died... 10:15:02.451520 run iperf3-srv_10.42.42.10(pid=24725): Terminated {rc=256} 10:15:02.498884 --- ParallelTerminationStrategy: PID 24728 died... 10:15:02.518597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24728): Terminated: ok {rc=0} 10:15:02.570473 --- ParallelTerminationStrategy: PID 24731 died... 10:15:02.598481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24731): Terminated: ok {rc=0} 10:15:02.674952 --- ParallelTerminationStrategy: PID 24734 died... 10:15:02.695359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24734): Terminated: ok {rc=0} 10:15:02.789996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:15:03.940613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:03.952815 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:15:04.023127 tst iperf3m4.py: using LAC 20762 10:15:04.142933 tst iperf3m4.py: using RAC 107 10:15:04.264772 tst iperf3m4.py: using CellId 20762 10:15:04.394054 tst iperf3m4.py: using BVCI 20763 10:15:04.516317 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.527994 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.539404 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.551142 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.562701 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.574186 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.585754 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.597127 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:04.608539 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:15:04.725354 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:15:04.847314 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:15:04.966220 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:15:05.081937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:15:05.287619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:05.597897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24746): Launched 10:15:05.867301 run iperf3-srv_10.42.42.10(pid=24747): Launched 10:15:05.983468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:15:06.188774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:06.497823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24748): Launched 10:15:06.767622 run iperf3-srv_10.42.42.10(pid=24749): Launched 10:15:06.883204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:15:07.087120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:07.396380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24750): Launched 10:15:07.664836 run iperf3-srv_10.42.42.10(pid=24751): Launched 10:15:07.781087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:15:07.986297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:08.295342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Launched 10:15:08.565729 run iperf3-srv_10.42.42.10(pid=24753): Launched 10:15:08.681744 tst iperf3m4.py:8: start network... 10:15:08.887372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:09.369295 run create_hlr_db(pid=24754): Launched 10:15:09.496207 bus /gobi_6: Setting Powered False 10:15:10.567594 run create_hlr_db(pid=24754): Terminated: ok {rc=0} 10:15:11.017031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24756): Launched 10:15:11.350085 run osmo-hlr_10.42.42.2(pid=24757): Launched 10:15:11.477796 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:12.049162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24759): Launched 10:15:12.379552 run osmo-stp_10.42.42.5(pid=24760): Launched 10:15:12.507720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:13.097863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24773): Launched 10:15:13.230264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:13.521739 run patchelf(pid=24854): Launched 10:15:13.707862 run osmo-stp_10.42.42.5(pid=24760): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24760)] 10:15:13.841284 run osmo-stp_10.42.42.5(pid=24760): stdout: | (launched: 2022-12-09_10:15:12.318759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:13.981608 run osmo-stp_10.42.42.5(pid=24760): stderr: | 20221209101512506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101512506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101512507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101512507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101512508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101512508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101512508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:14.126324 run osmo-stp_10.42.42.5(pid=24760): stdout: | (launched: 2022-12-09_10:15:12.318759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:14.265725 run osmo-stp_10.42.42.5(pid=24760): stderr: | 20221209101512506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101512506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101512507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101512507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101512508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101512508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101512508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:14.430888 run patchelf(pid=24854): Terminating (SIGINT) 10:15:14.621679 run patchelf(pid=24854): Terminated: ok {rc=0} 10:15:14.758837 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24760): Process ended prematurely: osmo-stp_10.42.42.5(pid=24760) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24760)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:15:14.770308 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:15:14.803706 run osmo-hlr_10.42.42.2(pid=24757): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24757)] 10:15:14.857724 run osmo-hlr_10.42.42.2(pid=24757): stdout: | (launched: 2022-12-09_10:15:11.289362) 10:15:14.912924 run osmo-hlr_10.42.42.2(pid=24757): stderr: | 20221209101511484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101511484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101511484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101511484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101511484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101511484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101511496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101511507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101511507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101511507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:14.968031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24746): Terminating (SIGTERM) 10:15:15.011407 run iperf3-srv_10.42.42.10(pid=24747): Terminating (SIGTERM) 10:15:15.054527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24748): Terminating (SIGTERM) 10:15:15.097752 run iperf3-srv_10.42.42.10(pid=24749): Terminating (SIGTERM) 10:15:15.140658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24750): Terminating (SIGTERM) 10:15:15.184118 run iperf3-srv_10.42.42.10(pid=24751): Terminating (SIGTERM) 10:15:15.227098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Terminating (SIGTERM) 10:15:15.270113 run iperf3-srv_10.42.42.10(pid=24753): Terminating (SIGTERM) 10:15:15.314492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24756): Terminating (SIGTERM) 10:15:15.358314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24759): Terminating (SIGTERM) 10:15:15.401265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24773): Terminating (SIGTERM) 10:15:15.444392 --- ParallelTerminationStrategy: PID 24746 died... 10:15:15.464567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24746): Terminated: ok {rc=0} 10:15:15.512811 --- ParallelTerminationStrategy: PID 24747 died... 10:15:15.533048 run iperf3-srv_10.42.42.10(pid=24747): Terminated {rc=256} 10:15:15.580652 --- ParallelTerminationStrategy: PID 24748 died... 10:15:15.600469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24748): Terminated: ok {rc=0} 10:15:15.648036 --- ParallelTerminationStrategy: PID 24749 died... 10:15:15.668061 run iperf3-srv_10.42.42.10(pid=24749): Terminated {rc=256} 10:15:15.715364 --- ParallelTerminationStrategy: PID 24750 died... 10:15:15.735359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24750): Terminated: ok {rc=0} 10:15:15.782710 --- ParallelTerminationStrategy: PID 24751 died... 10:15:15.802682 run iperf3-srv_10.42.42.10(pid=24751): Terminated {rc=256} 10:15:15.863000 --- ParallelTerminationStrategy: PID 24752 died... 10:15:15.883527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Terminated: ok {rc=0} 10:15:15.932308 --- ParallelTerminationStrategy: PID 24753 died... 10:15:15.953510 run iperf3-srv_10.42.42.10(pid=24753): Terminated {rc=256} 10:15:16.002322 --- ParallelTerminationStrategy: PID 24756 died... 10:15:16.025596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24756): Terminated: ok {rc=0} 10:15:16.074783 --- ParallelTerminationStrategy: PID 24759 died... 10:15:16.095046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24759): Terminated: ok {rc=0} 10:15:16.144117 --- ParallelTerminationStrategy: PID 24773 died... 10:15:16.164405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24773): Terminated: ok {rc=0} 10:15:16.255485 bus /gobi_4: Setting Powered False 10:15:17.358141 bus /gobi_4: Setting Powered False 10:15:18.475230 bus /gobi_1: Setting Powered False 10:15:19.574976 bus /gobi_1: Setting Powered False 10:15:20.694298 bus /gobi_0: Setting Powered False 10:15:21.794003 bus /gobi_0: Setting Powered False 10:15:22.913562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:15:24.022624 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.035693 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:15:24.116388 tst ping.py: using LAC 20763 10:15:24.246540 tst ping.py: using RAC 108 10:15:24.374731 tst ping.py: using CellId 20763 10:15:24.504580 tst ping.py: using BVCI 20764 10:15:24.626694 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.639060 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.651406 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.667459 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.680554 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.693328 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.706679 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:24.719773 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:15:24.838179 tst ping.py:19: start network... 10:15:25.059019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:25.569636 run create_hlr_db(pid=25291): Launched 10:15:25.734179 bus /gobi_6: Setting Powered False 10:15:26.799424 run create_hlr_db(pid=25291): Terminated: ok {rc=0} 10:15:27.259453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25293): Launched 10:15:27.604205 run osmo-hlr_10.42.42.2(pid=25294): Launched 10:15:27.855603 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:28.533547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25296): Launched 10:15:28.879852 run osmo-stp_10.42.42.5(pid=25297): Launched 10:15:29.137295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:29.777705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25303): Launched 10:15:29.902600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:30.176546 run patchelf(pid=25304): Launched 10:15:30.357961 run osmo-stp_10.42.42.5(pid=25297): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25297)] 10:15:30.494878 run osmo-stp_10.42.42.5(pid=25297): stdout: | (launched: 2022-12-09_10:15:28.819258) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:30.633671 run osmo-stp_10.42.42.5(pid=25297): stderr: | 20221209101529117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101529117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101529118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101529118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101529119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101529119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101529119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:30.771841 run osmo-stp_10.42.42.5(pid=25297): stdout: | (launched: 2022-12-09_10:15:28.819258) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:30.930683 run osmo-stp_10.42.42.5(pid=25297): stderr: | 20221209101529117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101529117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101529118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101529118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101529119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101529119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101529119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:31.102906 run patchelf(pid=25304): Terminating (SIGINT) 10:15:31.286279 run patchelf(pid=25304): Terminated: ok {rc=0} 10:15:31.423055 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25297): Process ended prematurely: osmo-stp_10.42.42.5(pid=25297) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25297)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 10:15:31.433390 tst ping.py:22: Test FAILED (7.4 sec) 10:15:31.463777 run osmo-hlr_10.42.42.2(pid=25294): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25294)] 10:15:31.516431 run osmo-hlr_10.42.42.2(pid=25294): stdout: | (launched: 2022-12-09_10:15:27.543637) 10:15:31.570853 run osmo-hlr_10.42.42.2(pid=25294): stderr: | 20221209101527850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101527850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101527850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101527850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101527850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101527850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101527869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101527885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101527885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101527885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:31.625642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25293): Terminating (SIGTERM) 10:15:31.669948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25296): Terminating (SIGTERM) 10:15:31.715496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25303): Terminating (SIGTERM) 10:15:31.761427 --- ParallelTerminationStrategy: PID 25293 died... 10:15:31.782222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25293): Terminated: ok {rc=0} 10:15:31.831973 --- ParallelTerminationStrategy: PID 25296 died... 10:15:31.852480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25296): Terminated: ok {rc=0} 10:15:31.900843 --- ParallelTerminationStrategy: PID 25303 died... 10:15:31.921396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25303): Terminated: ok {rc=0} 10:15:32.013188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:15:33.102924 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.115046 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:15:33.187570 tst ping_idle_ping.py: using LAC 20764 10:15:33.315933 tst ping_idle_ping.py: using RAC 109 10:15:33.444333 tst ping_idle_ping.py: using CellId 20764 10:15:33.573657 tst ping_idle_ping.py: using BVCI 20765 10:15:33.691735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.703182 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.714368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.726006 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.737475 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.748796 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.760331 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:15:33.771687 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:15:33.887522 tst ping_idle_ping.py:24: start network... 10:15:34.105978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:34.618862 run create_hlr_db(pid=25305): Launched 10:15:34.744121 bus /gobi_6: Setting Powered False 10:15:35.808390 run create_hlr_db(pid=25305): Terminated: ok {rc=0} 10:15:36.259275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25307): Launched 10:15:36.586576 run osmo-hlr_10.42.42.2(pid=25308): Launched 10:15:36.712464 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:37.273951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25310): Launched 10:15:37.598509 run osmo-stp_10.42.42.5(pid=25311): Launched 10:15:37.725762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:38.284060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25313): Launched 10:15:38.407405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:38.680397 run patchelf(pid=25314): Launched 10:15:38.862338 run osmo-stp_10.42.42.5(pid=25311): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25311)] 10:15:38.999539 run osmo-stp_10.42.42.5(pid=25311): stdout: | (launched: 2022-12-09_10:15:37.538646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:39.138161 run osmo-stp_10.42.42.5(pid=25311): stderr: | 20221209101537730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101537730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101537730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101537731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101537731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101537731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101537731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:39.276184 run osmo-stp_10.42.42.5(pid=25311): stdout: | (launched: 2022-12-09_10:15:37.538646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:39.409071 run osmo-stp_10.42.42.5(pid=25311): stderr: | 20221209101537730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101537730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101537730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101537731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101537731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101537731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101537731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:39.566399 run patchelf(pid=25314): Terminating (SIGINT) 10:15:39.746737 run patchelf(pid=25314): Terminated: ok {rc=0} 10:15:39.877092 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25311): Process ended prematurely: osmo-stp_10.42.42.5(pid=25311) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25311)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:15:39.886864 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:15:39.915685 run osmo-hlr_10.42.42.2(pid=25308): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25308)] 10:15:39.966822 run osmo-hlr_10.42.42.2(pid=25308): stdout: | (launched: 2022-12-09_10:15:36.526720) 10:15:40.019468 run osmo-hlr_10.42.42.2(pid=25308): stderr: | 20221209101536725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101536725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101536725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101536725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101536725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101536725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101536738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101536746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101536746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101536747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:40.072434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25307): Terminating (SIGTERM) 10:15:40.114901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25310): Terminating (SIGTERM) 10:15:40.157450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25313): Terminating (SIGTERM) 10:15:40.199944 --- ParallelTerminationStrategy: PID 25307 died... 10:15:40.220078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25307): Terminated: ok {rc=0} 10:15:40.267412 --- ParallelTerminationStrategy: PID 25310 died... 10:15:40.286969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25310): Terminated: ok {rc=0} 10:15:40.333962 --- ParallelTerminationStrategy: PID 25313 died... 10:15:40.353650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25313): Terminated: ok {rc=0} 10:15:40.442883 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:15:41.754142 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:41.761208 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:15:41.796082 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:15:41.835518 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:15:41.923837 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:15:41.957909 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:15:41.997039 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:15:42.592668 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:15:42.646042 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:42.657383 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:15:42.728591 tst cs_paging_gprs_active.py: using LAC 20765 10:15:42.858528 tst cs_paging_gprs_active.py: using RAC 110 10:15:42.995287 tst cs_paging_gprs_active.py: using CellId 20765 10:15:43.134440 tst cs_paging_gprs_active.py: using BVCI 20766 10:15:43.255997 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.267307 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.278486 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.290018 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.301331 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.312733 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.324335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.335673 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:43.347290 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:15:43.464401 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:15:43.579822 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:15:43.786614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:44.095684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25319): Launched 10:15:44.366784 run iperf3-srv_10.42.42.10(pid=25320): Launched 10:15:44.485579 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:15:44.692230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:45.002890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25321): Launched 10:15:45.273214 run iperf3-srv_10.42.42.10(pid=25322): Launched 10:15:45.389329 tst cs_paging_gprs_active.py:38: start network... 10:15:45.594829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:46.095309 run create_hlr_db(pid=25323): Launched 10:15:46.258845 bus /gobi_6: Setting Powered False 10:15:47.319856 run create_hlr_db(pid=25323): Terminated: ok {rc=0} 10:15:47.768871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25325): Launched 10:15:48.098491 run osmo-hlr_10.42.42.2(pid=25326): Launched 10:15:48.226109 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:48.795557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25328): Launched 10:15:49.125699 run osmo-stp_10.42.42.5(pid=25329): Launched 10:15:49.251538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:49.823028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25331): Launched 10:15:49.948833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:50.227044 run patchelf(pid=25332): Launched 10:15:50.411130 run osmo-stp_10.42.42.5(pid=25329): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25329)] 10:15:50.550757 run osmo-stp_10.42.42.5(pid=25329): stdout: | (launched: 2022-12-09_10:15:49.064288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:50.691889 run osmo-stp_10.42.42.5(pid=25329): stderr: | 20221209101549256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101549256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101549256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101549257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101549257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101549257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101549257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:50.832209 run osmo-stp_10.42.42.5(pid=25329): stdout: | (launched: 2022-12-09_10:15:49.064288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:50.967167 run osmo-stp_10.42.42.5(pid=25329): stderr: | 20221209101549256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101549256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101549256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101549257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101549257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101549257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101549257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:51.127525 run patchelf(pid=25332): Terminating (SIGINT) 10:15:51.312137 run patchelf(pid=25332): Terminated: ok {rc=0} 10:15:51.445300 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25329): Process ended prematurely: osmo-stp_10.42.42.5(pid=25329) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25329)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:15:51.455709 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:15:51.485666 run osmo-hlr_10.42.42.2(pid=25326): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25326)] 10:15:51.537410 run osmo-hlr_10.42.42.2(pid=25326): stdout: | (launched: 2022-12-09_10:15:48.038113) 10:15:51.590577 run osmo-hlr_10.42.42.2(pid=25326): stderr: | 20221209101548236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101548236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101548236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101548236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101548236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101548236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101548250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101548259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101548259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101548259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:51.643963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25319): Terminating (SIGTERM) 10:15:51.686937 run iperf3-srv_10.42.42.10(pid=25320): Terminating (SIGTERM) 10:15:51.729767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25321): Terminating (SIGTERM) 10:15:51.772614 run iperf3-srv_10.42.42.10(pid=25322): Terminating (SIGTERM) 10:15:51.815738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25325): Terminating (SIGTERM) 10:15:51.858616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25328): Terminating (SIGTERM) 10:15:51.901413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25331): Terminating (SIGTERM) 10:15:51.944247 --- ParallelTerminationStrategy: PID 25319 died... 10:15:51.964546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25319): Terminated: ok {rc=0} 10:15:52.012256 --- ParallelTerminationStrategy: PID 25320 died... 10:15:52.031997 run iperf3-srv_10.42.42.10(pid=25320): Terminated {rc=256} 10:15:52.079091 --- ParallelTerminationStrategy: PID 25321 died... 10:15:52.098926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25321): Terminated: ok {rc=0} 10:15:52.145878 --- ParallelTerminationStrategy: PID 25322 died... 10:15:52.165561 run iperf3-srv_10.42.42.10(pid=25322): Terminated {rc=256} 10:15:52.212836 --- ParallelTerminationStrategy: PID 25325 died... 10:15:52.233027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25325): Terminated: ok {rc=0} 10:15:52.280103 --- ParallelTerminationStrategy: PID 25328 died... 10:15:52.299808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25328): Terminated: ok {rc=0} 10:15:52.346983 --- ParallelTerminationStrategy: PID 25331 died... 10:15:52.366809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25331): Terminated: ok {rc=0} 10:15:52.456033 bus /gobi_0: Setting Powered False 10:15:53.558912 bus /gobi_0: Setting Powered False 10:15:54.677242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:15:55.827839 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:55.839864 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:15:55.920264 tst iperf3.py: using LAC 20766 10:15:56.048295 tst iperf3.py: using RAC 111 10:15:56.177318 tst iperf3.py: using CellId 20766 10:15:56.303843 tst iperf3.py: using BVCI 20767 10:15:56.423584 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.434915 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.446135 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.457581 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.468750 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.480210 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.491651 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.503054 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:15:56.514527 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:15:56.631185 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:15:56.837078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:57.145652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25333): Launched 10:15:57.415892 run iperf3-srv_10.42.42.10(pid=25334): Launched 10:15:57.531709 tst iperf3.py:8: start network... 10:15:57.735957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:58.214893 run create_hlr_db(pid=25335): Launched 10:15:58.340912 bus /gobi_6: Setting Powered False 10:15:59.405937 run create_hlr_db(pid=25335): Terminated: ok {rc=0} 10:15:59.844933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25337): Launched 10:16:00.152135 run osmo-hlr_10.42.42.2(pid=25338): Launched 10:16:00.269091 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:00.813589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25340): Launched 10:16:01.160804 run osmo-stp_10.42.42.5(pid=25341): Launched 10:16:01.405432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:02.092788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25343): Launched 10:16:02.254959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:02.517514 run patchelf(pid=25344): Launched 10:16:02.689352 run osmo-stp_10.42.42.5(pid=25341): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25341)] 10:16:02.819634 run osmo-stp_10.42.42.5(pid=25341): stdout: | (launched: 2022-12-09_10:16:01.102742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:02.951185 run osmo-stp_10.42.42.5(pid=25341): stderr: | 20221209101601435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101601435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101601435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101601435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101601436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101601436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101601436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:03.083043 run osmo-stp_10.42.42.5(pid=25341): stdout: | (launched: 2022-12-09_10:16:01.102742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:03.209315 run osmo-stp_10.42.42.5(pid=25341): stderr: | 20221209101601435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101601435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101601435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101601435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101601436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101601436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101601436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:03.359417 run patchelf(pid=25344): Terminating (SIGINT) 10:16:03.531837 run patchelf(pid=25344): Terminated: ok {rc=0} 10:16:03.656183 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25341): Process ended prematurely: osmo-stp_10.42.42.5(pid=25341) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25341)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 10:16:03.665988 tst iperf3.py:8: Test FAILED (7.9 sec) 10:16:03.693508 run osmo-hlr_10.42.42.2(pid=25338): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25338)] 10:16:03.741566 run osmo-hlr_10.42.42.2(pid=25338): stdout: | (launched: 2022-12-09_10:16:00.095331) 10:16:03.791305 run osmo-hlr_10.42.42.2(pid=25338): stderr: | 20221209101600271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101600271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101600271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101600271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101600271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101600271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101600284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101600295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101600295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101600295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:03.841494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25333): Terminating (SIGTERM) 10:16:03.881669 run iperf3-srv_10.42.42.10(pid=25334): Terminating (SIGTERM) 10:16:03.921976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25337): Terminating (SIGTERM) 10:16:03.962399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25340): Terminating (SIGTERM) 10:16:04.003092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25343): Terminating (SIGTERM) 10:16:04.043804 --- ParallelTerminationStrategy: PID 25333 died... 10:16:04.063327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25333): Terminated: ok {rc=0} 10:16:04.108003 --- ParallelTerminationStrategy: PID 25334 died... 10:16:04.126859 run iperf3-srv_10.42.42.10(pid=25334): Terminated {rc=256} 10:16:04.171084 --- ParallelTerminationStrategy: PID 25337 died... 10:16:04.190100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25337): Terminated: ok {rc=0} 10:16:04.234391 --- ParallelTerminationStrategy: PID 25340 died... 10:16:04.253171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25340): Terminated: ok {rc=0} 10:16:04.297282 --- ParallelTerminationStrategy: PID 25343 died... 10:16:04.315845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25343): Terminated: ok {rc=0} 10:16:04.403097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:16:05.552680 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:05.564422 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:16:05.635367 tst iperf3m4.py: using LAC 20767 10:16:05.759345 tst iperf3m4.py: using RAC 112 10:16:05.881484 tst iperf3m4.py: using CellId 20767 10:16:06.003671 tst iperf3m4.py: using BVCI 20768 10:16:06.114819 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.125787 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.136500 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.147257 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.158004 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.168609 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.179440 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.190100 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:06.201074 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:16:06.320670 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:16:06.439276 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:16:06.560910 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:16:06.679785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:16:06.886177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:07.195472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25345): Launched 10:16:07.464439 run iperf3-srv_10.42.42.10(pid=25346): Launched 10:16:07.582642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:16:07.787794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:08.097135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25347): Launched 10:16:08.366818 run iperf3-srv_10.42.42.10(pid=25348): Launched 10:16:08.485148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:16:08.690177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:08.998928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25349): Launched 10:16:09.267855 run iperf3-srv_10.42.42.10(pid=25350): Launched 10:16:09.383588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:16:09.588690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:09.897597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25351): Launched 10:16:10.171887 run iperf3-srv_10.42.42.10(pid=25352): Launched 10:16:10.287489 tst iperf3m4.py:8: start network... 10:16:10.492203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:10.972742 run create_hlr_db(pid=25353): Launched 10:16:11.098520 bus /gobi_6: Setting Powered False 10:16:12.159512 run create_hlr_db(pid=25353): Terminated: ok {rc=0} 10:16:12.610791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25355): Launched 10:16:12.942749 run osmo-hlr_10.42.42.2(pid=25356): Launched 10:16:13.069882 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:13.644337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25358): Launched 10:16:13.974677 run osmo-stp_10.42.42.5(pid=25359): Launched 10:16:14.101524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:14.671224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25361): Launched 10:16:14.798072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:15.076481 run patchelf(pid=25362): Launched 10:16:15.261448 run osmo-stp_10.42.42.5(pid=25359): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25359)] 10:16:15.400498 run osmo-stp_10.42.42.5(pid=25359): stdout: | (launched: 2022-12-09_10:16:13.914024) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:15.541216 run osmo-stp_10.42.42.5(pid=25359): stderr: | 20221209101614103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101614103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101614103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101614104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101614104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101614104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101614104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:15.681878 run osmo-stp_10.42.42.5(pid=25359): stdout: | (launched: 2022-12-09_10:16:13.914024) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:15.817383 run osmo-stp_10.42.42.5(pid=25359): stderr: | 20221209101614103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101614103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101614103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101614104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101614104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101614104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101614104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:16.004380 run patchelf(pid=25362): Terminating (SIGINT) 10:16:16.191810 run patchelf(pid=25362): Terminated: ok {rc=0} 10:16:16.328707 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25359): Process ended prematurely: osmo-stp_10.42.42.5(pid=25359) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25359)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:16:16.340341 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:16:16.373669 run osmo-hlr_10.42.42.2(pid=25356): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25356)] 10:16:16.427271 run osmo-hlr_10.42.42.2(pid=25356): stdout: | (launched: 2022-12-09_10:16:12.882320) 10:16:16.482669 run osmo-hlr_10.42.42.2(pid=25356): stderr: | 20221209101613076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101613077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101613077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101613077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101613077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101613077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101613095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101613105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101613105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101613105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:16.538939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25345): Terminating (SIGTERM) 10:16:16.585101 run iperf3-srv_10.42.42.10(pid=25346): Terminating (SIGTERM) 10:16:16.632768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25347): Terminating (SIGTERM) 10:16:16.678163 run iperf3-srv_10.42.42.10(pid=25348): Terminating (SIGTERM) 10:16:16.725559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25349): Terminating (SIGTERM) 10:16:16.771017 run iperf3-srv_10.42.42.10(pid=25350): Terminating (SIGTERM) 10:16:16.818328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25351): Terminating (SIGTERM) 10:16:16.864040 run iperf3-srv_10.42.42.10(pid=25352): Terminating (SIGTERM) 10:16:16.911328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25355): Terminating (SIGTERM) 10:16:16.956560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25358): Terminating (SIGTERM) 10:16:17.001211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25361): Terminating (SIGTERM) 10:16:17.045923 --- ParallelTerminationStrategy: PID 25345 died... 10:16:17.066729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25345): Terminated: ok {rc=0} 10:16:17.117060 --- ParallelTerminationStrategy: PID 25346 died... 10:16:17.138270 run iperf3-srv_10.42.42.10(pid=25346): Terminated {rc=256} 10:16:17.186945 --- ParallelTerminationStrategy: PID 25347 died... 10:16:17.206698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25347): Terminated: ok {rc=0} 10:16:17.254684 --- ParallelTerminationStrategy: PID 25348 died... 10:16:17.274388 run iperf3-srv_10.42.42.10(pid=25348): Terminated {rc=256} 10:16:17.322364 --- ParallelTerminationStrategy: PID 25349 died... 10:16:17.342156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25349): Terminated: ok {rc=0} 10:16:17.390464 --- ParallelTerminationStrategy: PID 25350 died... 10:16:17.410209 run iperf3-srv_10.42.42.10(pid=25350): Terminated {rc=256} 10:16:17.458326 --- ParallelTerminationStrategy: PID 25351 died... 10:16:17.478188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25351): Terminated: ok {rc=0} 10:16:17.526293 --- ParallelTerminationStrategy: PID 25352 died... 10:16:17.546321 run iperf3-srv_10.42.42.10(pid=25352): Terminated {rc=256} 10:16:17.594524 --- ParallelTerminationStrategy: PID 25355 died... 10:16:17.614315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25355): Terminated: ok {rc=0} 10:16:17.662563 --- ParallelTerminationStrategy: PID 25358 died... 10:16:17.682696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25358): Terminated: ok {rc=0} 10:16:17.731114 --- ParallelTerminationStrategy: PID 25361 died... 10:16:17.750992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25361): Terminated: ok {rc=0} 10:16:17.842440 bus /gobi_4: Setting Powered False 10:16:18.943166 bus /gobi_4: Setting Powered False 10:16:20.061186 bus /gobi_1: Setting Powered False 10:16:21.161570 bus /gobi_1: Setting Powered False 10:16:22.279742 bus /gobi_0: Setting Powered False 10:16:23.379438 bus /gobi_0: Setting Powered False 10:16:24.496394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:16:25.599357 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:25.611461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:16:25.684209 tst ping.py: using LAC 20768 10:16:25.811928 tst ping.py: using RAC 113 10:16:25.940113 tst ping.py: using CellId 20768 10:16:26.068722 tst ping.py: using BVCI 20769 10:16:26.188354 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.199963 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.211172 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.222699 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.233944 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.245383 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.257268 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:26.268694 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:16:26.388631 tst ping.py:19: start network... 10:16:26.605516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:27.104730 run create_hlr_db(pid=25363): Launched 10:16:27.229448 bus /gobi_6: Setting Powered False 10:16:28.292801 run create_hlr_db(pid=25363): Terminated: ok {rc=0} 10:16:28.725155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25365): Launched 10:16:29.029771 run osmo-hlr_10.42.42.2(pid=25366): Launched 10:16:29.147316 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:29.680597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25368): Launched 10:16:29.983085 run osmo-stp_10.42.42.5(pid=25369): Launched 10:16:30.098029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:30.618514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25371): Launched 10:16:30.736478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:31.009711 run patchelf(pid=25372): Launched 10:16:31.202133 run osmo-stp_10.42.42.5(pid=25369): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25369)] 10:16:31.345779 run osmo-stp_10.42.42.5(pid=25369): stdout: | (launched: 2022-12-09_10:16:29.927042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:31.487981 run osmo-stp_10.42.42.5(pid=25369): stderr: | 20221209101630095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101630096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101630096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101630096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101630097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101630097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101630097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:31.652938 run osmo-stp_10.42.42.5(pid=25369): stdout: | (launched: 2022-12-09_10:16:29.927042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:31.793212 run osmo-stp_10.42.42.5(pid=25369): stderr: | 20221209101630095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101630096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101630096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101630096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101630097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101630097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101630097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:31.955208 run patchelf(pid=25372): Terminating (SIGINT) 10:16:32.141660 run patchelf(pid=25372): Terminated: ok {rc=0} 10:16:32.273820 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25369): Process ended prematurely: osmo-stp_10.42.42.5(pid=25369) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25369)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 10:16:32.283739 tst ping.py:22: Test FAILED (6.7 sec) 10:16:32.313273 run osmo-hlr_10.42.42.2(pid=25366): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25366)] 10:16:32.365138 run osmo-hlr_10.42.42.2(pid=25366): stdout: | (launched: 2022-12-09_10:16:28.972896) 10:16:32.418065 run osmo-hlr_10.42.42.2(pid=25366): stderr: | 20221209101629149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101629149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101629149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101629149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101629149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101629149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101629162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101629170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101629170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101629170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:32.471617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25365): Terminating (SIGTERM) 10:16:32.514502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25368): Terminating (SIGTERM) 10:16:32.558585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25371): Terminating (SIGTERM) 10:16:32.602142 --- ParallelTerminationStrategy: PID 25365 died... 10:16:32.622554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25365): Terminated: ok {rc=0} 10:16:32.670069 --- ParallelTerminationStrategy: PID 25368 died... 10:16:32.689951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25368): Terminated: ok {rc=0} 10:16:32.737423 --- ParallelTerminationStrategy: PID 25371 died... 10:16:32.757263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25371): Terminated: ok {rc=0} 10:16:32.847332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:16:33.935962 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:33.947996 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:16:34.025778 tst ping_idle_ping.py: using LAC 20769 10:16:34.152687 tst ping_idle_ping.py: using RAC 114 10:16:34.282589 tst ping_idle_ping.py: using CellId 20769 10:16:34.409977 tst ping_idle_ping.py: using BVCI 20770 10:16:34.530063 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.541460 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.552891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.564889 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.576208 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.587658 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.599355 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:16:34.610706 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:16:34.729110 tst ping_idle_ping.py:24: start network... 10:16:34.930191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:35.402666 run create_hlr_db(pid=25373): Launched 10:16:35.529718 bus /gobi_6: Setting Powered False 10:16:36.594201 run create_hlr_db(pid=25373): Terminated: ok {rc=0} 10:16:37.046363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25375): Launched 10:16:37.372589 run osmo-hlr_10.42.42.2(pid=25376): Launched 10:16:37.496820 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:38.060596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25378): Launched 10:16:38.386938 run osmo-stp_10.42.42.5(pid=25379): Launched 10:16:38.512161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:39.071585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25381): Launched 10:16:39.195400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:39.469258 run patchelf(pid=25382): Launched 10:16:39.651362 run osmo-stp_10.42.42.5(pid=25379): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25379)] 10:16:39.788510 run osmo-stp_10.42.42.5(pid=25379): stdout: | (launched: 2022-12-09_10:16:38.327158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:39.927058 run osmo-stp_10.42.42.5(pid=25379): stderr: | 20221209101638517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101638517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101638518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101638518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101638518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101638519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101638519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:40.065759 run osmo-stp_10.42.42.5(pid=25379): stdout: | (launched: 2022-12-09_10:16:38.327158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:40.198731 run osmo-stp_10.42.42.5(pid=25379): stderr: | 20221209101638517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101638517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101638518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101638518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101638518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101638519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101638519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:40.356392 run patchelf(pid=25382): Terminating (SIGINT) 10:16:40.537812 run patchelf(pid=25382): Terminated: ok {rc=0} 10:16:40.668825 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25379): Process ended prematurely: osmo-stp_10.42.42.5(pid=25379) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25379)] [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:16:40.678733 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:16:40.707781 run osmo-hlr_10.42.42.2(pid=25376): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25376)] 10:16:40.759260 run osmo-hlr_10.42.42.2(pid=25376): stdout: | (launched: 2022-12-09_10:16:37.313037) 10:16:40.811826 run osmo-hlr_10.42.42.2(pid=25376): stderr: | 20221209101637511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101637511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101637511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101637511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101637511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101637511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101637524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101637533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101637533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101637533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:40.864766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25375): Terminating (SIGTERM) 10:16:40.907383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25378): Terminating (SIGTERM) 10:16:40.949945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25381): Terminating (SIGTERM) 10:16:40.992560 --- ParallelTerminationStrategy: PID 25375 died... 10:16:41.012518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25375): Terminated: ok {rc=0} 10:16:41.059634 --- ParallelTerminationStrategy: PID 25378 died... 10:16:41.079185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25378): Terminated: ok {rc=0} 10:16:41.126139 --- ParallelTerminationStrategy: PID 25381 died... 10:16:41.145931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25381): Terminated: ok {rc=0} 10:16:41.237238 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:16:42.545489 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:42.552363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:16:42.586901 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:16:42.626406 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:16:42.714765 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:16:42.748581 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:16:42.787965 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:16:43.385027 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:16:43.434948 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:43.446492 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:16:43.499069 tst cs_paging_gprs_active.py: using LAC 20770 10:16:43.620621 tst cs_paging_gprs_active.py: using RAC 115 10:16:43.742547 tst cs_paging_gprs_active.py: using CellId 20770 10:16:43.865135 tst cs_paging_gprs_active.py: using BVCI 20771 10:16:43.977995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:43.989292 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.000239 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.011270 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.022247 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.033246 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.044247 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.055149 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:44.066337 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:16:44.185621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:16:44.302666 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:16:44.509866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:44.821153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25387): Launched 10:16:45.090589 run iperf3-srv_10.42.42.10(pid=25388): Launched 10:16:45.208609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:16:45.414046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:45.724460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25389): Launched 10:16:46.002607 run iperf3-srv_10.42.42.10(pid=25390): Launched 10:16:46.166816 tst cs_paging_gprs_active.py:38: start network... 10:16:46.395213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:46.924402 run create_hlr_db(pid=25391): Launched 10:16:47.103962 bus /gobi_6: Setting Powered False 10:16:48.164208 run create_hlr_db(pid=25391): Terminated: ok {rc=0} 10:16:48.623446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25393): Launched 10:16:48.955251 run osmo-hlr_10.42.42.2(pid=25394): Launched 10:16:49.082940 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:49.651892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25396): Launched 10:16:49.983524 run osmo-stp_10.42.42.5(pid=25397): Launched 10:16:50.110750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:50.680057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25399): Launched 10:16:50.808461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:51.088586 run patchelf(pid=25400): Launched 10:16:51.273217 run osmo-stp_10.42.42.5(pid=25397): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25397)] 10:16:51.412507 run osmo-stp_10.42.42.5(pid=25397): stdout: | (launched: 2022-12-09_10:16:49.922960) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:51.552924 run osmo-stp_10.42.42.5(pid=25397): stderr: | 20221209101650113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101650113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101650113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101650114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101650114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101650114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101650114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:51.693921 run osmo-stp_10.42.42.5(pid=25397): stdout: | (launched: 2022-12-09_10:16:49.922960) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:51.829260 run osmo-stp_10.42.42.5(pid=25397): stderr: | 20221209101650113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101650113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101650113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101650114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101650114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101650114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101650114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:51.989574 run patchelf(pid=25400): Terminating (SIGINT) 10:16:52.173122 run patchelf(pid=25400): Terminated: ok {rc=0} 10:16:52.306084 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25397): Process ended prematurely: osmo-stp_10.42.42.5(pid=25397) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25397)] [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:16:52.316608 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:16:52.346457 run osmo-hlr_10.42.42.2(pid=25394): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25394)] 10:16:52.397402 run osmo-hlr_10.42.42.2(pid=25394): stdout: | (launched: 2022-12-09_10:16:48.894839) 10:16:52.450029 run osmo-hlr_10.42.42.2(pid=25394): stderr: | 20221209101649092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101649092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101649092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101649092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101649092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101649092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101649105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101649114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101649114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101649114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:52.503068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25387): Terminating (SIGTERM) 10:16:52.545530 run iperf3-srv_10.42.42.10(pid=25388): Terminating (SIGTERM) 10:16:52.588369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25389): Terminating (SIGTERM) 10:16:52.630977 run iperf3-srv_10.42.42.10(pid=25390): Terminating (SIGTERM) 10:16:52.673334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25393): Terminating (SIGTERM) 10:16:52.715790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25396): Terminating (SIGTERM) 10:16:52.758088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25399): Terminating (SIGTERM) 10:16:52.800520 --- ParallelTerminationStrategy: PID 25387 died... 10:16:52.820264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25387): Terminated: ok {rc=0} 10:16:52.867620 --- ParallelTerminationStrategy: PID 25388 died... 10:16:52.887322 run iperf3-srv_10.42.42.10(pid=25388): Terminated {rc=256} 10:16:52.934242 --- ParallelTerminationStrategy: PID 25389 died... 10:16:52.953969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25389): Terminated: ok {rc=0} 10:16:53.000645 --- ParallelTerminationStrategy: PID 25390 died... 10:16:53.020228 run iperf3-srv_10.42.42.10(pid=25390): Terminated {rc=256} 10:16:53.066865 --- ParallelTerminationStrategy: PID 25393 died... 10:16:53.086492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25393): Terminated: ok {rc=0} 10:16:53.133212 --- ParallelTerminationStrategy: PID 25396 died... 10:16:53.153243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25396): Terminated: ok {rc=0} 10:16:53.199889 --- ParallelTerminationStrategy: PID 25399 died... 10:16:53.219497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25399): Terminated: ok {rc=0} 10:16:53.308272 bus /gobi_0: Setting Powered False 10:16:54.408185 bus /gobi_0: Setting Powered False 10:16:55.524869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:16:56.675785 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:56.688095 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:16:56.748677 tst iperf3.py: using LAC 20771 10:16:56.877661 tst iperf3.py: using RAC 116 10:16:56.997295 tst iperf3.py: using CellId 20771 10:16:57.115903 tst iperf3.py: using BVCI 20772 10:16:57.227230 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.238634 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.249869 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.261159 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.272142 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.283117 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.294297 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.305238 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:16:57.316501 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:16:57.431715 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:16:57.638186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:57.947989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25401): Launched 10:16:58.216712 run iperf3-srv_10.42.42.10(pid=25402): Launched 10:16:58.332181 tst iperf3.py:8: start network... 10:16:58.536659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:59.013698 run create_hlr_db(pid=25403): Launched 10:16:59.139421 bus /gobi_6: Setting Powered False 10:17:00.200070 run create_hlr_db(pid=25403): Terminated: ok {rc=0} 10:17:00.648312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25405): Launched 10:17:01.005763 run osmo-hlr_10.42.42.2(pid=25406): Launched 10:17:01.247544 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:01.946882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25411): Launched 10:17:02.294285 run osmo-stp_10.42.42.5(pid=25412): Launched 10:17:02.423488 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:02.998444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25414): Launched 10:17:03.126983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:03.406305 run patchelf(pid=25415): Launched 10:17:03.589945 run osmo-stp_10.42.42.5(pid=25412): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25412)] 10:17:03.729178 run osmo-stp_10.42.42.5(pid=25412): stdout: | (launched: 2022-12-09_10:17:02.236708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:03.869929 run osmo-stp_10.42.42.5(pid=25412): stderr: | 20221209101702423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101702423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101702423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101702424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101702424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101702424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101702424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:04.010699 run osmo-stp_10.42.42.5(pid=25412): stdout: | (launched: 2022-12-09_10:17:02.236708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:04.146083 run osmo-stp_10.42.42.5(pid=25412): stderr: | 20221209101702423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101702423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101702423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101702424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101702424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101702424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101702424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:04.306658 run patchelf(pid=25415): Terminating (SIGINT) 10:17:04.491161 run patchelf(pid=25415): Terminated: ok {rc=0} 10:17:04.624518 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25412): Process ended prematurely: osmo-stp_10.42.42.5(pid=25412) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25412)] [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:17:04.634990 tst iperf3.py:8: Test FAILED (8.0 sec) 10:17:04.664617 run osmo-hlr_10.42.42.2(pid=25406): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25406)] 10:17:04.715325 run osmo-hlr_10.42.42.2(pid=25406): stdout: | (launched: 2022-12-09_10:17:00.938806) 10:17:04.767863 run osmo-hlr_10.42.42.2(pid=25406): stderr: | 20221209101701278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101701278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101701278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101701278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101701278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101701278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101701295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101701311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101701312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101701312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:04.820999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25401): Terminating (SIGTERM) 10:17:04.863392 run iperf3-srv_10.42.42.10(pid=25402): Terminating (SIGTERM) 10:17:04.905625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25405): Terminating (SIGTERM) 10:17:04.948360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25411): Terminating (SIGTERM) 10:17:04.990906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25414): Terminating (SIGTERM) 10:17:05.033550 --- ParallelTerminationStrategy: PID 25401 died... 10:17:05.053742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25401): Terminated: ok {rc=0} 10:17:05.100778 --- ParallelTerminationStrategy: PID 25402 died... 10:17:05.120666 run iperf3-srv_10.42.42.10(pid=25402): Terminated {rc=256} 10:17:05.167493 --- ParallelTerminationStrategy: PID 25405 died... 10:17:05.187151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25405): Terminated: ok {rc=0} 10:17:05.233858 --- ParallelTerminationStrategy: PID 25411 died... 10:17:05.253447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25411): Terminated: ok {rc=0} 10:17:05.300624 --- ParallelTerminationStrategy: PID 25414 died... 10:17:05.320365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25414): Terminated: ok {rc=0} 10:17:05.409778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:17:06.562204 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:06.574793 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:17:06.629703 tst iperf3m4.py: using LAC 20772 10:17:06.752503 tst iperf3m4.py: using RAC 117 10:17:06.872558 tst iperf3m4.py: using CellId 20772 10:17:06.993889 tst iperf3m4.py: using BVCI 20773 10:17:07.106042 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.117548 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.128601 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.140290 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.151880 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.163553 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.175288 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.187090 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:07.198927 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:17:07.316171 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:17:07.439497 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:17:07.558586 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:17:07.679113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:17:07.891427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:08.201435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25416): Launched 10:17:08.472155 run iperf3-srv_10.42.42.10(pid=25417): Launched 10:17:08.588593 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:17:08.793965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:09.118033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25418): Launched 10:17:09.407065 run iperf3-srv_10.42.42.10(pid=25419): Launched 10:17:09.533279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:17:09.755332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:10.086849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25420): Launched 10:17:10.375243 run iperf3-srv_10.42.42.10(pid=25421): Launched 10:17:10.500578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:17:10.722915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:11.055702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25422): Launched 10:17:11.346767 run iperf3-srv_10.42.42.10(pid=25423): Launched 10:17:11.470879 tst iperf3m4.py:8: start network... 10:17:11.693202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:12.208125 run create_hlr_db(pid=25424): Launched 10:17:12.335341 bus /gobi_6: Setting Powered False 10:17:13.395959 run create_hlr_db(pid=25424): Terminated: ok {rc=0} 10:17:13.854258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25426): Launched 10:17:14.184212 run osmo-hlr_10.42.42.2(pid=25427): Launched 10:17:14.309880 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:14.882960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25429): Launched 10:17:15.215279 run osmo-stp_10.42.42.5(pid=25430): Launched 10:17:15.339931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:15.926208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25432): Launched 10:17:16.081877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:16.365303 run patchelf(pid=25433): Launched 10:17:16.564562 run osmo-stp_10.42.42.5(pid=25430): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25430)] 10:17:16.707502 run osmo-stp_10.42.42.5(pid=25430): stdout: | (launched: 2022-12-09_10:17:15.154054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:16.850989 run osmo-stp_10.42.42.5(pid=25430): stderr: | 20221209101715345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101715345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101715345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101715346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101715346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101715346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101715346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:16.995592 run osmo-stp_10.42.42.5(pid=25430): stdout: | (launched: 2022-12-09_10:17:15.154054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:17.135077 run osmo-stp_10.42.42.5(pid=25430): stderr: | 20221209101715345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101715345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101715345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101715346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101715346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101715346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101715346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:17.299349 run patchelf(pid=25433): Terminating (SIGINT) 10:17:17.484374 run patchelf(pid=25433): Terminated: ok {rc=0} 10:17:17.618374 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25430): Process ended prematurely: osmo-stp_10.42.42.5(pid=25430) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25430)] [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:17:17.629090 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:17:17.659222 run osmo-hlr_10.42.42.2(pid=25427): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25427)] 10:17:17.710660 run osmo-hlr_10.42.42.2(pid=25427): stdout: | (launched: 2022-12-09_10:17:14.123377) 10:17:17.764172 run osmo-hlr_10.42.42.2(pid=25427): stderr: | 20221209101714319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101714319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101714319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101714319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101714319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101714319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101714332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101714341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101714341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101714341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:17.817517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25416): Terminating (SIGTERM) 10:17:17.860157 run iperf3-srv_10.42.42.10(pid=25417): Terminating (SIGTERM) 10:17:17.902977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25418): Terminating (SIGTERM) 10:17:17.945683 run iperf3-srv_10.42.42.10(pid=25419): Terminating (SIGTERM) 10:17:17.988341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25420): Terminating (SIGTERM) 10:17:18.031284 run iperf3-srv_10.42.42.10(pid=25421): Terminating (SIGTERM) 10:17:18.074001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25422): Terminating (SIGTERM) 10:17:18.116783 run iperf3-srv_10.42.42.10(pid=25423): Terminating (SIGTERM) 10:17:18.159852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25426): Terminating (SIGTERM) 10:17:18.202624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25429): Terminating (SIGTERM) 10:17:18.245383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25432): Terminating (SIGTERM) 10:17:18.288290 --- ParallelTerminationStrategy: PID 25416 died... 10:17:18.308568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25416): Terminated: ok {rc=0} 10:17:18.355931 --- ParallelTerminationStrategy: PID 25417 died... 10:17:18.375722 run iperf3-srv_10.42.42.10(pid=25417): Terminated {rc=256} 10:17:18.422674 --- ParallelTerminationStrategy: PID 25418 died... 10:17:18.442489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25418): Terminated: ok {rc=0} 10:17:18.489568 --- ParallelTerminationStrategy: PID 25419 died... 10:17:18.509357 run iperf3-srv_10.42.42.10(pid=25419): Terminated {rc=256} 10:17:18.556301 --- ParallelTerminationStrategy: PID 25420 died... 10:17:18.576421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25420): Terminated: ok {rc=0} 10:17:18.623545 --- ParallelTerminationStrategy: PID 25421 died... 10:17:18.643184 run iperf3-srv_10.42.42.10(pid=25421): Terminated {rc=256} 10:17:18.690004 --- ParallelTerminationStrategy: PID 25422 died... 10:17:18.709746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25422): Terminated: ok {rc=0} 10:17:18.756808 --- ParallelTerminationStrategy: PID 25423 died... 10:17:18.776829 run iperf3-srv_10.42.42.10(pid=25423): Terminated {rc=256} 10:17:18.823764 --- ParallelTerminationStrategy: PID 25426 died... 10:17:18.843524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25426): Terminated: ok {rc=0} 10:17:18.890880 --- ParallelTerminationStrategy: PID 25429 died... 10:17:18.910787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25429): Terminated: ok {rc=0} 10:17:18.957989 --- ParallelTerminationStrategy: PID 25432 died... 10:17:18.977663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25432): Terminated: ok {rc=0} 10:17:19.067152 bus /gobi_4: Setting Powered False 10:17:20.167510 bus /gobi_4: Setting Powered False 10:17:21.284105 bus /gobi_1: Setting Powered False 10:17:22.382763 bus /gobi_1: Setting Powered False 10:17:23.500249 bus /gobi_0: Setting Powered False 10:17:24.596132 bus /gobi_0: Setting Powered False 10:17:25.715193 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:17:26.815480 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:26.827322 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:17:26.879655 tst ping.py: using LAC 20773 10:17:26.999591 tst ping.py: using RAC 118 10:17:27.119919 tst ping.py: using CellId 20773 10:17:27.238257 tst ping.py: using BVCI 20774 10:17:27.348574 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.359940 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.371088 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.382236 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.393223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.404231 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.415493 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:27.426512 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:17:27.542102 tst ping.py:19: start network... 10:17:27.741529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:28.207703 run create_hlr_db(pid=25434): Launched 10:17:28.331753 bus /gobi_6: Setting Powered False 10:17:29.395436 run create_hlr_db(pid=25434): Terminated: ok {rc=0} 10:17:29.827691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25436): Launched 10:17:30.130324 run osmo-hlr_10.42.42.2(pid=25437): Launched 10:17:30.244818 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:30.783515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25439): Launched 10:17:31.129811 run osmo-stp_10.42.42.5(pid=25440): Launched 10:17:31.317902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:32.164186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25442): Launched 10:17:32.293792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:32.569101 run patchelf(pid=25443): Launched 10:17:32.751871 run osmo-stp_10.42.42.5(pid=25440): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25440)] 10:17:32.889306 run osmo-stp_10.42.42.5(pid=25440): stdout: | (launched: 2022-12-09_10:17:31.069048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:33.027437 run osmo-stp_10.42.42.5(pid=25440): stderr: | 20221209101731483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101731484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101731484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101731487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101731490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101731490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101731490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:33.166168 run osmo-stp_10.42.42.5(pid=25440): stdout: | (launched: 2022-12-09_10:17:31.069048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:33.299177 run osmo-stp_10.42.42.5(pid=25440): stderr: | 20221209101731483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101731484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101731484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101731487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101731490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101731490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101731490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:33.456247 run patchelf(pid=25443): Terminating (SIGINT) 10:17:33.637510 run patchelf(pid=25443): Terminated: ok {rc=0} 10:17:33.767871 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25440): Process ended prematurely: osmo-stp_10.42.42.5(pid=25440) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25440)] [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:17:33.777604 tst ping.py:22: Test FAILED (7.0 sec) 10:17:33.806943 run osmo-hlr_10.42.42.2(pid=25437): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25437)] 10:17:33.857940 run osmo-hlr_10.42.42.2(pid=25437): stdout: | (launched: 2022-12-09_10:17:30.074067) 10:17:33.910567 run osmo-hlr_10.42.42.2(pid=25437): stderr: | 20221209101730249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101730250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101730250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101730250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101730250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101730250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101730262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101730273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101730274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101730274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:33.963565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25436): Terminating (SIGTERM) 10:17:34.005987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25439): Terminating (SIGTERM) 10:17:34.048443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25442): Terminating (SIGTERM) 10:17:34.091369 --- ParallelTerminationStrategy: PID 25436 died... 10:17:34.111789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25436): Terminated: ok {rc=0} 10:17:34.158714 --- ParallelTerminationStrategy: PID 25439 died... 10:17:34.178449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25439): Terminated: ok {rc=0} 10:17:34.225418 --- ParallelTerminationStrategy: PID 25442 died... 10:17:34.245177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25442): Terminated: ok {rc=0} 10:17:34.334486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:17:35.423241 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:35.435210 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:17:35.491916 tst ping_idle_ping.py: using LAC 20774 10:17:35.610844 tst ping_idle_ping.py: using RAC 119 10:17:35.730323 tst ping_idle_ping.py: using CellId 20774 10:17:35.857038 tst ping_idle_ping.py: using BVCI 20775 10:17:35.975182 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:35.987014 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:35.998709 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:36.010660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:36.022397 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:36.034201 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:36.046211 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:17:36.058041 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:17:36.175848 tst ping_idle_ping.py:24: start network... 10:17:36.377680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:36.850295 run create_hlr_db(pid=25444): Launched 10:17:36.977120 bus /gobi_6: Setting Powered False 10:17:38.037620 run create_hlr_db(pid=25444): Terminated: ok {rc=0} 10:17:38.480714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25446): Launched 10:17:38.807496 run osmo-hlr_10.42.42.2(pid=25447): Launched 10:17:38.932817 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:39.489764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25449): Launched 10:17:39.815392 run osmo-stp_10.42.42.5(pid=25450): Launched 10:17:39.941157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:40.502344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25452): Launched 10:17:40.627399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:40.901205 run patchelf(pid=25453): Launched 10:17:41.082170 run osmo-stp_10.42.42.5(pid=25450): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25450)] 10:17:41.219891 run osmo-stp_10.42.42.5(pid=25450): stdout: | (launched: 2022-12-09_10:17:39.755557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:41.358731 run osmo-stp_10.42.42.5(pid=25450): stderr: | 20221209101739948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101739949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101739949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101739949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101739950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101739950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101739950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:41.497187 run osmo-stp_10.42.42.5(pid=25450): stdout: | (launched: 2022-12-09_10:17:39.755557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:41.630942 run osmo-stp_10.42.42.5(pid=25450): stderr: | 20221209101739948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101739949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101739949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101739949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101739950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101739950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101739950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:41.788212 run patchelf(pid=25453): Terminating (SIGINT) 10:17:41.969633 run patchelf(pid=25453): Terminated: ok {rc=0} 10:17:42.100493 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25450): Process ended prematurely: osmo-stp_10.42.42.5(pid=25450) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25450)] [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:17:42.110446 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:17:42.139254 run osmo-hlr_10.42.42.2(pid=25447): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25447)] 10:17:42.190524 run osmo-hlr_10.42.42.2(pid=25447): stdout: | (launched: 2022-12-09_10:17:38.747800) 10:17:42.243389 run osmo-hlr_10.42.42.2(pid=25447): stderr: | 20221209101738946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101738946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101738946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101738946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101738946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101738947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101738959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101738967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101738968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101738968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:42.296738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25446): Terminating (SIGTERM) 10:17:42.339420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25449): Terminating (SIGTERM) 10:17:42.382303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25452): Terminating (SIGTERM) 10:17:42.425218 --- ParallelTerminationStrategy: PID 25446 died... 10:17:42.445490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25446): Terminated: ok {rc=0} 10:17:42.492755 --- ParallelTerminationStrategy: PID 25449 died... 10:17:42.512547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25449): Terminated: ok {rc=0} 10:17:42.559367 --- ParallelTerminationStrategy: PID 25452 died... 10:17:42.579404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25452): Terminated: ok {rc=0} 10:17:42.668081 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:17:43.983150 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:43.990564 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:17:44.024871 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:17:44.060332 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:17:44.115327 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:17:44.149661 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:17:44.185226 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:17:44.743178 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:17:44.752381 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:44.764376 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:17:44.836057 tst switch_tch_pdch.py: using LAC 20775 10:17:44.955241 tst switch_tch_pdch.py: using RAC 120 10:17:45.079466 tst switch_tch_pdch.py: using CellId 20775 10:17:45.198407 tst switch_tch_pdch.py: using BVCI 20776 10:17:45.310469 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.321802 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.332812 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.343899 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.354851 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.365852 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.377002 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:17:45.387922 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:17:45.507093 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:17:45.627779 tst switch_tch_pdch.py:51: start network... 10:17:45.846125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:46.354938 run create_hlr_db(pid=25458): Launched 10:17:46.518119 bus /gobi_6: Setting Powered False 10:17:47.582699 run create_hlr_db(pid=25458): Terminated: ok {rc=0} 10:17:48.016016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25460): Launched 10:17:48.323478 run osmo-hlr_10.42.42.2(pid=25461): Launched 10:17:48.450231 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:49.007987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25463): Launched 10:17:49.333572 run osmo-stp_10.42.42.5(pid=25464): Launched 10:17:49.458950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:50.018659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25466): Launched 10:17:50.143523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:50.416224 run patchelf(pid=25467): Launched 10:17:50.598228 run osmo-stp_10.42.42.5(pid=25464): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25464)] 10:17:50.735357 run osmo-stp_10.42.42.5(pid=25464): stdout: | (launched: 2022-12-09_10:17:49.273217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:50.873978 run osmo-stp_10.42.42.5(pid=25464): stderr: | 20221209101749464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101749465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101749465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101749465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101749466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101749466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101749466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:51.012391 run osmo-stp_10.42.42.5(pid=25464): stdout: | (launched: 2022-12-09_10:17:49.273217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:51.145181 run osmo-stp_10.42.42.5(pid=25464): stderr: | 20221209101749464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101749465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101749465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101749465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101749466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101749466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101749466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:51.302868 run patchelf(pid=25467): Terminating (SIGINT) 10:17:51.483871 run patchelf(pid=25467): Terminated: ok {rc=0} 10:17:51.614768 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25464): Process ended prematurely: osmo-stp_10.42.42.5(pid=25464) [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25464)] [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:17:51.624381 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:17:51.653627 run osmo-hlr_10.42.42.2(pid=25461): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25461)] 10:17:51.704406 run osmo-hlr_10.42.42.2(pid=25461): stdout: | (launched: 2022-12-09_10:17:48.262320) 10:17:51.757279 run osmo-hlr_10.42.42.2(pid=25461): stderr: | 20221209101748457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101748457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101748457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101748457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101748458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101748458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101748469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101748478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101748478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101748478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:51.810289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25460): Terminating (SIGTERM) 10:17:51.852938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25463): Terminating (SIGTERM) 10:17:51.895700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25466): Terminating (SIGTERM) 10:17:51.938572 --- ParallelTerminationStrategy: PID 25460 died... 10:17:51.959032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25460): Terminated: ok {rc=0} 10:17:52.006345 --- ParallelTerminationStrategy: PID 25463 died... 10:17:52.026185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25463): Terminated: ok {rc=0} 10:17:52.073288 --- ParallelTerminationStrategy: PID 25466 died... 10:17:52.093353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25466): Terminated: ok {rc=0} 10:17:52.182719 bus /gobi_0: Setting Powered False 10:17:53.282669 bus /gobi_0: Setting Powered False 10:17:54.402554 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:17:55.662229 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:55.669776 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:17:55.702999 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:17:55.737077 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:17:55.790991 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:17:55.824129 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:17:55.858099 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:17:56.415631 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:17:56.420613 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:56.431547 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:17:56.498899 tst switch_tch_pdch.py: using LAC 20776 10:17:56.618556 tst switch_tch_pdch.py: using RAC 121 10:17:56.737048 tst switch_tch_pdch.py: using CellId 20776 10:17:56.854113 tst switch_tch_pdch.py: using BVCI 20777 10:17:56.962907 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:56.973856 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:56.984480 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:56.995190 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:57.005960 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:57.016626 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:57.027466 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:17:57.038126 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:17:57.157739 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:17:57.280032 tst switch_tch_pdch.py:51: start network... 10:17:57.497638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:57.971911 run create_hlr_db(pid=25471): Launched 10:17:58.098173 bus /gobi_6: Setting Powered False 10:17:59.162512 run create_hlr_db(pid=25471): Terminated: ok {rc=0} 10:17:59.570792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25473): Launched 10:17:59.872318 run osmo-hlr_10.42.42.2(pid=25474): Launched 10:17:59.986383 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:00.479230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25476): Launched 10:18:00.781326 run osmo-stp_10.42.42.5(pid=25477): Launched 10:18:00.978395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:18:01.579528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25479): Launched 10:18:01.719872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:18:02.009798 run patchelf(pid=25480): Launched 10:18:02.186574 run osmo-stp_10.42.42.5(pid=25477): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25477)] 10:18:02.315760 run osmo-stp_10.42.42.5(pid=25477): stdout: | (launched: 2022-12-09_10:18:00.724840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:02.445133 run osmo-stp_10.42.42.5(pid=25477): stderr: | 20221209101800977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101800977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101800978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101800978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101800978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101800978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101800979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:02.574215 run osmo-stp_10.42.42.5(pid=25477): stdout: | (launched: 2022-12-09_10:18:00.724840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:02.698246 run osmo-stp_10.42.42.5(pid=25477): stderr: | 20221209101800977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101800977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101800978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101800978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101800978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101800978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101800979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:02.844829 run patchelf(pid=25480): Terminating (SIGINT) 10:18:03.014284 run patchelf(pid=25480): Terminated: ok {rc=0} 10:18:03.136117 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25477): Process ended prematurely: osmo-stp_10.42.42.5(pid=25477) [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25477)] [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:18:03.145284 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:18:03.172338 run osmo-hlr_10.42.42.2(pid=25474): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25474)] 10:18:03.220630 run osmo-hlr_10.42.42.2(pid=25474): stdout: | (launched: 2022-12-09_10:17:59.816194) 10:18:03.270992 run osmo-hlr_10.42.42.2(pid=25474): stderr: | 20221209101759991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101759991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101759991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101759991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101759991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101759991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101800008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101800018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101800019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101800019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:03.321720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25473): Terminating (SIGTERM) 10:18:03.362275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25476): Terminating (SIGTERM) 10:18:03.403206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25479): Terminating (SIGTERM) 10:18:03.443774 --- ParallelTerminationStrategy: PID 25473 died... 10:18:03.463127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25473): Terminated: ok {rc=0} 10:18:03.507706 --- ParallelTerminationStrategy: PID 25476 died... 10:18:03.526718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25476): Terminated: ok {rc=0} 10:18:03.571558 --- ParallelTerminationStrategy: PID 25479 died... 10:18:03.590454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25479): Terminated: ok {rc=0} 10:18:03.677481 bus /gobi_0: Setting Powered False 10:18:04.775732 bus /gobi_0: Setting Powered False 10:18:05.892282 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:18:07.145764 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:07.149959 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:18:07.183173 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:18:07.189877 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:18:07.243061 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:18:07.276358 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:18:07.282948 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:18:07.819096 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:18:07.823924 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:18:07.834757 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:18:07.882815 tst mo_mt_sms.py: using LAC 20777 10:18:08.002691 tst mo_mt_sms.py: using RAC 122 10:18:08.121201 tst mo_mt_sms.py: using CellId 20777 10:18:08.241205 tst mo_mt_sms.py: using BVCI 20778 10:18:08.351298 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:18:08.469908 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:18:08.583312 tst mo_mt_sms.py:9: start nitb and bts... 10:18:08.785273 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:18:09.400059 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25484): Launched 10:18:09.702429 run osmo-nitb_10.42.42.2(pid=25485): Launched 10:18:09.871582 run osmo-nitb_10.42.42.2(pid=25485): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25485)] 10:18:10.006310 run osmo-nitb_10.42.42.2(pid=25485): stdout: | (launched: 2022-12-09_10:18:09.646223) 10:18:10.142038 run osmo-nitb_10.42.42.2(pid=25485): stderr: | (launched: 2022-12-09_10:18:09.690961) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:18:10.277771 run osmo-nitb_10.42.42.2(pid=25485): stdout: | (launched: 2022-12-09_10:18:09.646223) 10:18:10.408601 run osmo-nitb_10.42.42.2(pid=25485): stderr: | (launched: 2022-12-09_10:18:09.690961) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25485) [trial-2358↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25485)] 10:18:10.818094 tst osmo-nitb_10.42.42.2(pid=25485): stdout: | (launched: 2022-12-09_10:18:09.646223) 10:18:10.939101 tst osmo-nitb_10.42.42.2(pid=25485): stderr: | (launched: 2022-12-09_10:18:09.690961) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:18:11.081629 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25485) [trial-2358↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25485)] [trial-2358↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 10:18:11.090099 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:18:11.096731 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25484): Terminating (SIGTERM) 10:18:11.305618 --- ParallelTerminationStrategy: PID 25484 died... 10:18:11.326876 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25484): Terminated: ok {rc=0} 10:18:11.413932 bus /sierra_3: Setting Powered False 10:18:12.514487 bus /sierra_3: Setting Powered False 10:18:13.632780 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:18:14.833921 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:14.838205 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:18:14.871564 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:18:14.897866 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:18:14.950757 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:18:14.984283 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:18:15.010325 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:18:15.562916 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:18:15.568154 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:15.579235 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:18:15.632310 tst mo_mt_sms.py: using LAC 20778 10:18:15.758414 tst mo_mt_sms.py: using RAC 123 10:18:15.895153 tst mo_mt_sms.py: using CellId 20778 10:18:16.025447 tst mo_mt_sms.py: using BVCI 20779 10:18:16.137880 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:16.149100 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:16.160712 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:16.172294 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:16.184028 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:16.195100 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:18:16.327859 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:18:16.466026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:16.979000 run create_hlr_db(pid=25489): Launched 10:18:17.145828 bus /sierra_2: Setting Powered False 10:18:18.206792 run create_hlr_db(pid=25489): Terminated: ok {rc=0} 10:18:18.629735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25491): Launched 10:18:18.932804 run osmo-hlr_10.42.42.2(pid=25492): Launched 10:18:19.049104 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:19.570629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25494): Launched 10:18:19.873103 run osmo-stp_10.42.42.5(pid=25495): Launched 10:18:19.987510 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:20.533521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25497): Launched 10:18:20.838477 run osmo-msc_10.42.42.6(pid=25498): Launched 10:18:21.007304 run osmo-stp_10.42.42.5(pid=25495): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25495)] 10:18:21.134977 run osmo-stp_10.42.42.5(pid=25495): stdout: | (launched: 2022-12-09_10:18:19.816693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:21.262242 run osmo-stp_10.42.42.5(pid=25495): stderr: | 20221209101819988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101819988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101819988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101819988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101819989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101819989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101819989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:21.387627 run osmo-stp_10.42.42.5(pid=25495): stdout: | (launched: 2022-12-09_10:18:19.816693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:21.507291 run osmo-stp_10.42.42.5(pid=25495): stderr: | 20221209101819988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101819988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101819988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101819988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101819989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101819989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101819989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:21.651268 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25495): Process ended prematurely: osmo-stp_10.42.42.5(pid=25495) [trial-2358↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25495)] [trial-2358↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 10:18:21.659490 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 10:18:21.685572 run osmo-hlr_10.42.42.2(pid=25492): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25492)] 10:18:21.733622 run osmo-hlr_10.42.42.2(pid=25492): stdout: | (launched: 2022-12-09_10:18:18.875597) 10:18:21.783343 run osmo-hlr_10.42.42.2(pid=25492): stderr: | 20221209101819050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101819050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101819051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101819051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101819051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101819051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101819067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101819077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101819077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101819078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:21.852623 run osmo-msc_10.42.42.6(pid=25498): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25498)] 10:18:21.900743 run osmo-msc_10.42.42.6(pid=25498): stdout: | (launched: 2022-12-09_10:18:20.781682) 10:18:21.950752 run osmo-msc_10.42.42.6(pid=25498): stderr: | 20221209101821055 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101821055 DLGLOBAL DEBUG validating counter group 0x7fbe84f00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101821055 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101821055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101821055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101821055 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101821058 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101821059 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101821059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101821059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:22.000656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25491): Terminating (SIGTERM) 10:18:22.040707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25494): Terminating (SIGTERM) 10:18:22.080498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25497): Terminating (SIGTERM) 10:18:22.120663 --- ParallelTerminationStrategy: PID 25491 died... 10:18:22.139969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25491): Terminated: ok {rc=0} 10:18:22.184083 --- ParallelTerminationStrategy: PID 25494 died... 10:18:22.202727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25494): Terminated: ok {rc=0} 10:18:22.246508 --- ParallelTerminationStrategy: PID 25497 died... 10:18:22.265132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25497): Terminated: ok {rc=0} 10:18:22.348304 bus /sierra_3: Setting Powered False 10:18:23.447685 bus /sierra_3: Setting Powered False 10:18:24.564756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:18:25.796224 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:25.800322 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:18:25.835345 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:18:25.842420 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:18:25.879461 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:18:25.914449 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:18:25.921455 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:18:26.441401 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:18:26.446757 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:18:26.458226 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:18:26.508405 tst assert_extension.py: using LAC 20779 10:18:26.634748 tst assert_extension.py: using RAC 124 10:18:26.761660 tst assert_extension.py: using CellId 20779 10:18:26.890570 tst assert_extension.py: using BVCI 20780 10:18:27.009574 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:18:27.130416 tst assert_extension.py:10: start nitb and bts... 10:18:27.347327 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:18:28.008574 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25503): Launched 10:18:28.334288 run osmo-nitb_10.42.42.2(pid=25504): Launched 10:18:28.515648 run osmo-nitb_10.42.42.2(pid=25504): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25504)] 10:18:28.660592 run osmo-nitb_10.42.42.2(pid=25504): stdout: | (launched: 2022-12-09_10:18:28.274526) 10:18:28.807161 run osmo-nitb_10.42.42.2(pid=25504): stderr: | (launched: 2022-12-09_10:18:28.322594) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:18:28.952676 run osmo-nitb_10.42.42.2(pid=25504): stdout: | (launched: 2022-12-09_10:18:28.274526) 10:18:29.093878 run osmo-nitb_10.42.42.2(pid=25504): stderr: | (launched: 2022-12-09_10:18:28.322594) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25504): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25504) [trial-2358↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25504)] 10:18:29.457947 tst osmo-nitb_10.42.42.2(pid=25504): stdout: | (launched: 2022-12-09_10:18:28.274526) 10:18:29.590530 tst osmo-nitb_10.42.42.2(pid=25504): stderr: | (launched: 2022-12-09_10:18:28.322594) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:18:29.745414 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25504): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25504) [trial-2358↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25504)] [trial-2358↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 10:18:29.754791 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:18:29.762175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25503): Terminating (SIGTERM) 10:18:29.974428 --- ParallelTerminationStrategy: PID 25503 died... 10:18:29.996622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25503): Terminated: ok {rc=0} 10:18:30.086939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:18:31.286528 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:31.294134 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:18:31.343625 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:18:31.380180 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:18:31.425349 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:18:31.472597 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:18:31.511809 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:18:32.018381 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:18:32.027285 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:32.041506 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:18:32.105604 tst assert_extension.py: using LAC 20780 10:18:32.234722 tst assert_extension.py: using RAC 125 10:18:32.364067 tst assert_extension.py: using CellId 20780 10:18:32.490628 tst assert_extension.py: using BVCI 20781 10:18:32.610249 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:32.621591 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:32.632769 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:32.644167 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:32.655679 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:32.667104 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:18:32.781739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:33.249616 run create_hlr_db(pid=25508): Launched 10:18:33.374938 bus /sierra_2: Setting Powered False 10:18:34.435020 run create_hlr_db(pid=25508): Terminated: ok {rc=0} 10:18:34.857130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25510): Launched 10:18:35.159879 run osmo-hlr_10.42.42.2(pid=25511): Launched 10:18:35.274975 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:35.902463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25513): Launched 10:18:36.203701 run osmo-stp_10.42.42.5(pid=25514): Launched 10:18:36.318449 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:36.860840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25516): Launched 10:18:37.158592 run osmo-msc_10.42.42.6(pid=25517): Launched 10:18:37.327559 run osmo-stp_10.42.42.5(pid=25514): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25514)] 10:18:37.453249 run osmo-stp_10.42.42.5(pid=25514): stdout: | (launched: 2022-12-09_10:18:36.148191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:37.580494 run osmo-stp_10.42.42.5(pid=25514): stderr: | 20221209101836315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101836315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101836315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101836316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101836316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101836316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101836317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:37.705295 run osmo-stp_10.42.42.5(pid=25514): stdout: | (launched: 2022-12-09_10:18:36.148191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:37.823455 run osmo-stp_10.42.42.5(pid=25514): stderr: | 20221209101836315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101836315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101836315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101836316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101836316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101836316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101836317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:37.965262 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25514): Process ended prematurely: osmo-stp_10.42.42.5(pid=25514) [trial-2358↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25514)] [trial-2358↪ussd:trx-sysmocell5000↪assert_extension.py:17] 10:18:37.973687 tst assert_extension.py:17: Test FAILED (5.9 sec) 10:18:38.000088 run osmo-hlr_10.42.42.2(pid=25511): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25511)] 10:18:38.048260 run osmo-hlr_10.42.42.2(pid=25511): stdout: | (launched: 2022-12-09_10:18:35.103583) 10:18:38.098122 run osmo-hlr_10.42.42.2(pid=25511): stderr: | 20221209101835278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101835278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101835278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101835278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101835278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101835278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101835290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101835299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101835299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101835299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:38.167233 run osmo-msc_10.42.42.6(pid=25517): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25517)] 10:18:38.215306 run osmo-msc_10.42.42.6(pid=25517): stdout: | (launched: 2022-12-09_10:18:37.103037) 10:18:38.264816 run osmo-msc_10.42.42.6(pid=25517): stderr: | 20221209101837374 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101837374 DLGLOBAL DEBUG validating counter group 0x7feb3400ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101837374 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101837374 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101837374 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101837374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101837376 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101837377 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101837378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101837378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:38.314868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25510): Terminating (SIGTERM) 10:18:38.354746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25513): Terminating (SIGTERM) 10:18:38.394743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25516): Terminating (SIGTERM) 10:18:38.434931 --- ParallelTerminationStrategy: PID 25510 died... 10:18:38.454275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25510): Terminated: ok {rc=0} 10:18:38.498436 --- ParallelTerminationStrategy: PID 25513 died... 10:18:38.517063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25513): Terminated: ok {rc=0} 10:18:38.561180 --- ParallelTerminationStrategy: PID 25516 died... 10:18:38.579781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25516): Terminated: ok {rc=0} 10:18:38.663941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:18:39.876480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:39.884108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:18:39.919699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:18:39.947053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:18:39.999486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:18:40.033741 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:18:40.060761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:18:40.613627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:18:40.667018 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:40.678598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:18:40.749822 tst mo_mt_call.py: using LAC 20781 10:18:40.876407 tst mo_mt_call.py: using RAC 126 10:18:41.004621 tst mo_mt_call.py: using CellId 20781 10:18:41.133710 tst mo_mt_call.py: using BVCI 20782 10:18:41.253392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:41.264872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:41.276340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:41.288101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:41.299898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:41.311499 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:18:41.427361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:18:41.547153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:42.022972 run create_hlr_db(pid=25522): Launched 10:18:42.149172 bus /sierra_2: Setting Powered False 10:18:43.209700 run create_hlr_db(pid=25522): Terminated: ok {rc=0} 10:18:43.653095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25524): Launched 10:18:43.979821 run osmo-hlr_10.42.42.2(pid=25525): Launched 10:18:44.106232 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:44.665474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25527): Launched 10:18:44.992532 run osmo-stp_10.42.42.5(pid=25528): Launched 10:18:45.117118 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:45.707286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25530): Launched 10:18:46.043972 run osmo-msc_10.42.42.6(pid=25531): Launched 10:18:46.306493 run osmo-stp_10.42.42.5(pid=25528): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25528)] 10:18:46.609880 run osmo-stp_10.42.42.5(pid=25528): stdout: | (launched: 2022-12-09_10:18:44.932448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:46.743725 run osmo-stp_10.42.42.5(pid=25528): stderr: | 20221209101845123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101845124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101845124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101845124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101845125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101845125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101845125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:46.873838 run osmo-stp_10.42.42.5(pid=25528): stdout: | (launched: 2022-12-09_10:18:44.932448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:46.998283 run osmo-stp_10.42.42.5(pid=25528): stderr: | 20221209101845123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101845124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101845124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101845124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101845125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101845125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101845125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:47.148594 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25528): Process ended prematurely: osmo-stp_10.42.42.5(pid=25528) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25528)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:18:47.159029 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:18:47.189054 run osmo-hlr_10.42.42.2(pid=25525): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25525)] 10:18:47.238680 run osmo-hlr_10.42.42.2(pid=25525): stdout: | (launched: 2022-12-09_10:18:43.919958) 10:18:47.290610 run osmo-hlr_10.42.42.2(pid=25525): stderr: | 20221209101844117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101844117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101844117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101844117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101844117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101844117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101844129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101844138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101844138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101844138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:47.364416 run osmo-msc_10.42.42.6(pid=25531): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25531)] 10:18:47.413562 run osmo-msc_10.42.42.6(pid=25531): stdout: | (launched: 2022-12-09_10:18:45.984267) 10:18:47.463987 run osmo-msc_10.42.42.6(pid=25531): stderr: | 20221209101846419 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101846420 DLGLOBAL DEBUG validating counter group 0x7fb09376ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101846420 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101846420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101846420 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101846420 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101846424 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101846424 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101846424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101846424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:47.514315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25524): Terminating (SIGTERM) 10:18:47.554506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25527): Terminating (SIGTERM) 10:18:47.594514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25530): Terminating (SIGTERM) 10:18:47.634716 --- ParallelTerminationStrategy: PID 25524 died... 10:18:47.653801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25524): Terminated: ok {rc=0} 10:18:47.698364 --- ParallelTerminationStrategy: PID 25527 died... 10:18:47.717056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25527): Terminated: ok {rc=0} 10:18:47.761689 --- ParallelTerminationStrategy: PID 25530 died... 10:18:47.780328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25530): Terminated: ok {rc=0} 10:18:47.865069 bus /sierra_3: Setting Powered False 10:18:48.964919 bus /sierra_3: Setting Powered False 10:18:50.084224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:18:51.230308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:51.242214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:18:51.311987 tst mo_mt_call_osmux.py: using LAC 20782 10:18:51.430810 tst mo_mt_call_osmux.py: using RAC 127 10:18:51.551545 tst mo_mt_call_osmux.py: using CellId 20782 10:18:51.672396 tst mo_mt_call_osmux.py: using BVCI 20783 10:18:51.784218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:51.795486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:51.806566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:51.817598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:51.828549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:18:51.839519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:18:51.959553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:18:52.077384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:52.550393 run create_hlr_db(pid=25533): Launched 10:18:52.676759 bus /sierra_2: Setting Powered False 10:18:53.737203 run create_hlr_db(pid=25533): Terminated: ok {rc=0} 10:18:54.181265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25535): Launched 10:18:54.507342 run osmo-hlr_10.42.42.2(pid=25536): Launched 10:18:54.634819 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:55.201701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25538): Launched 10:18:55.530080 run osmo-stp_10.42.42.5(pid=25539): Launched 10:18:55.653796 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:56.210317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25541): Launched 10:18:56.514731 run osmo-msc_10.42.42.6(pid=25542): Launched 10:18:56.686035 run osmo-stp_10.42.42.5(pid=25539): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25539)] 10:18:56.820763 run osmo-stp_10.42.42.5(pid=25539): stdout: | (launched: 2022-12-09_10:18:55.469782) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:56.960663 run osmo-stp_10.42.42.5(pid=25539): stderr: | 20221209101855646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101855646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101855646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101855646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101855647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101855647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101855647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:57.095767 run osmo-stp_10.42.42.5(pid=25539): stdout: | (launched: 2022-12-09_10:18:55.469782) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:57.225339 run osmo-stp_10.42.42.5(pid=25539): stderr: | 20221209101855646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101855646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101855646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101855646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101855647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101855647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101855647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:57.380289 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25539): Process ended prematurely: osmo-stp_10.42.42.5(pid=25539) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25539)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:18:57.390106 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:18:57.418483 run osmo-hlr_10.42.42.2(pid=25536): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25536)] 10:18:57.469175 run osmo-hlr_10.42.42.2(pid=25536): stdout: | (launched: 2022-12-09_10:18:54.447646) 10:18:57.521396 run osmo-hlr_10.42.42.2(pid=25536): stderr: | 20221209101854645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101854645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101854645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101854645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101854645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101854646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101854658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101854667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101854667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101854667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:57.594293 run osmo-msc_10.42.42.6(pid=25542): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25542)] 10:18:57.645059 run osmo-msc_10.42.42.6(pid=25542): stdout: | (launched: 2022-12-09_10:18:56.458209) 10:18:57.697243 run osmo-msc_10.42.42.6(pid=25542): stderr: | 20221209101856735 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101856735 DLGLOBAL DEBUG validating counter group 0x7fd71ae4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101856735 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101856735 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101856735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101856736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101856737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101856738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101856738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101856738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:57.749554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25535): Terminating (SIGTERM) 10:18:57.791551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25538): Terminating (SIGTERM) 10:18:57.834044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25541): Terminating (SIGTERM) 10:18:57.876438 --- ParallelTerminationStrategy: PID 25535 died... 10:18:57.896498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25535): Terminated: ok {rc=0} 10:18:57.943498 --- ParallelTerminationStrategy: PID 25538 died... 10:18:57.962962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25538): Terminated: ok {rc=0} 10:18:58.009636 --- ParallelTerminationStrategy: PID 25541 died... 10:18:58.029258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25541): Terminated: ok {rc=0} 10:18:58.118232 bus /sierra_3: Setting Powered False 10:18:59.216364 bus /sierra_3: Setting Powered False 10:19:00.331806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:19:01.630410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:19:01.637997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:19:01.673654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:19:01.702773 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:19:01.754338 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:19:01.790757 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:19:01.818622 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:19:02.369891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:19:02.422522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:02.434345 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:19:02.507021 tst mo_mt_call.py: using LAC 20783 10:19:02.635265 tst mo_mt_call.py: using RAC 128 10:19:02.765780 tst mo_mt_call.py: using CellId 20783 10:19:02.893737 tst mo_mt_call.py: using BVCI 20784 10:19:03.004300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:03.015507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:03.026570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:03.038028 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:03.049541 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:03.061036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:19:03.181404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:19:03.301581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:03.807381 run create_hlr_db(pid=25547): Launched 10:19:03.932683 bus /sierra_2: Setting Powered False 10:19:04.997114 run create_hlr_db(pid=25547): Terminated: ok {rc=0} 10:19:05.450273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25549): Launched 10:19:05.778978 run osmo-hlr_10.42.42.2(pid=25550): Launched 10:19:05.905525 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:06.465377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25552): Launched 10:19:06.793480 run osmo-stp_10.42.42.5(pid=25553): Launched 10:19:06.919139 run osmo-msc_10.42.42.6: Starting osmo-msc 10:19:07.518193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25555): Launched 10:19:07.844940 run osmo-msc_10.42.42.6(pid=25556): Launched 10:19:08.028240 run osmo-stp_10.42.42.5(pid=25553): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25553)] 10:19:08.167003 run osmo-stp_10.42.42.5(pid=25553): stdout: | (launched: 2022-12-09_10:19:06.733503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:08.305595 run osmo-stp_10.42.42.5(pid=25553): stderr: | 20221209101906924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101906924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101906924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101906925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101906925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101906925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101906925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:08.442593 run osmo-stp_10.42.42.5(pid=25553): stdout: | (launched: 2022-12-09_10:19:06.733503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:08.572517 run osmo-stp_10.42.42.5(pid=25553): stderr: | 20221209101906924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101906924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101906924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101906925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101906925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101906925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101906925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:08.728911 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25553): Process ended prematurely: osmo-stp_10.42.42.5(pid=25553) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25553)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:19:08.738756 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:19:08.767778 run osmo-hlr_10.42.42.2(pid=25550): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25550)] 10:19:08.819140 run osmo-hlr_10.42.42.2(pid=25550): stdout: | (launched: 2022-12-09_10:19:05.718569) 10:19:08.872089 run osmo-hlr_10.42.42.2(pid=25550): stderr: | 20221209101905916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101905916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101905916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101905916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101905916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101905917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101905974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101905984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101905984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101905984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:08.945819 run osmo-msc_10.42.42.6(pid=25556): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25556)] 10:19:08.997174 run osmo-msc_10.42.42.6(pid=25556): stdout: | (launched: 2022-12-09_10:19:07.784877) 10:19:09.049929 run osmo-msc_10.42.42.6(pid=25556): stderr: | 20221209101908105 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101908105 DLGLOBAL DEBUG validating counter group 0x7f526a687c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101908106 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101908106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101908106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101908106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101908108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101908108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101908108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101908108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:09.103189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25549): Terminating (SIGTERM) 10:19:09.145639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25552): Terminating (SIGTERM) 10:19:09.188335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25555): Terminating (SIGTERM) 10:19:09.231136 --- ParallelTerminationStrategy: PID 25549 died... 10:19:09.251336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25549): Terminated: ok {rc=0} 10:19:09.298450 --- ParallelTerminationStrategy: PID 25552 died... 10:19:09.318102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25552): Terminated: ok {rc=0} 10:19:09.365418 --- ParallelTerminationStrategy: PID 25555 died... 10:19:09.385176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25555): Terminated: ok {rc=0} 10:19:09.474141 bus /sierra_3: Setting Powered False 10:19:10.574052 bus /sierra_3: Setting Powered False 10:19:11.688492 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:19:12.831984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:12.843855 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:19:12.913820 tst mo_mt_call_osmux.py: using LAC 20784 10:19:13.033791 tst mo_mt_call_osmux.py: using RAC 129 10:19:13.155973 tst mo_mt_call_osmux.py: using CellId 20784 10:19:13.274976 tst mo_mt_call_osmux.py: using BVCI 20785 10:19:13.384153 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:13.395353 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:13.406340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:13.417316 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:13.428319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:19:13.439320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:19:13.554226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:19:13.674517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:14.180621 run create_hlr_db(pid=25558): Launched 10:19:14.307377 bus /sierra_2: Setting Powered False 10:19:15.371482 run create_hlr_db(pid=25558): Terminated: ok {rc=0} 10:19:15.805658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25560): Launched 10:19:16.161746 run osmo-hlr_10.42.42.2(pid=25561): Launched 10:19:16.392429 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:17.127886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25563): Launched 10:19:17.474206 run osmo-stp_10.42.42.5(pid=25564): Launched 10:19:17.602773 run osmo-msc_10.42.42.6: Starting osmo-msc 10:19:18.198227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25566): Launched 10:19:18.526649 run osmo-msc_10.42.42.6(pid=25567): Launched 10:19:18.713371 run osmo-stp_10.42.42.5(pid=25564): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25564)] 10:19:18.851006 run osmo-stp_10.42.42.5(pid=25564): stdout: | (launched: 2022-12-09_10:19:17.414021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:18.989738 run osmo-stp_10.42.42.5(pid=25564): stderr: | 20221209101917605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101917605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101917605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101917606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101917606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101917606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101917606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:19.126088 run osmo-stp_10.42.42.5(pid=25564): stdout: | (launched: 2022-12-09_10:19:17.414021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:19.256657 run osmo-stp_10.42.42.5(pid=25564): stderr: | 20221209101917605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101917605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101917605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101917606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101917606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101917606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101917606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:19.412384 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25564): Process ended prematurely: osmo-stp_10.42.42.5(pid=25564) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25564)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:19:19.422329 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:19:19.450744 run osmo-hlr_10.42.42.2(pid=25561): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25561)] 10:19:19.500876 run osmo-hlr_10.42.42.2(pid=25561): stdout: | (launched: 2022-12-09_10:19:16.091942) 10:19:19.553162 run osmo-hlr_10.42.42.2(pid=25561): stderr: | 20221209101916417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101916417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101916417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101916417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101916417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101916417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101916442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101916460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101916460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101916460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:19.626144 run osmo-msc_10.42.42.6(pid=25567): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25567)] 10:19:19.676624 run osmo-msc_10.42.42.6(pid=25567): stdout: | (launched: 2022-12-09_10:19:18.466226) 10:19:19.728586 run osmo-msc_10.42.42.6(pid=25567): stderr: | 20221209101918787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101918787 DLGLOBAL DEBUG validating counter group 0x7fd06ea65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101918788 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101918788 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101918788 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101918788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101918790 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101918790 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101918790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101918790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:19.780900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25560): Terminating (SIGTERM) 10:19:19.823056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25563): Terminating (SIGTERM) 10:19:19.865273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25566): Terminating (SIGTERM) 10:19:19.907522 --- ParallelTerminationStrategy: PID 25560 died... 10:19:19.927485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25560): Terminated: ok {rc=0} 10:19:19.974063 --- ParallelTerminationStrategy: PID 25563 died... 10:19:19.993601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25563): Terminated: ok {rc=0} 10:19:20.040034 --- ParallelTerminationStrategy: PID 25566 died... 10:19:20.059457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25566): Terminated: ok {rc=0} 10:19:20.147896 bus /sierra_3: Setting Powered False 10:19:21.248538 bus /sierra_3: Setting Powered False 10:19:22.364943 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:19:23.622386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:19:23.630047 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:19:23.665228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:19:23.692562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:19:23.745874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:19:23.778956 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:19:23.805125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:19:24.357696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:19:24.406141 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:24.417348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:19:24.489742 tst mo_mt_call.py: using LAC 20785 10:19:24.609095 tst mo_mt_call.py: using RAC 130 10:19:24.726399 tst mo_mt_call.py: using CellId 20785 10:19:24.845111 tst mo_mt_call.py: using BVCI 20786 10:19:24.954667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:24.965842 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:24.976803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:24.987825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:24.998938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:25.009964 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:19:25.129438 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:19:25.245896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:25.721583 run create_hlr_db(pid=25572): Launched 10:19:25.847023 bus /sierra_2: Setting Powered False 10:19:26.907161 run create_hlr_db(pid=25572): Terminated: ok {rc=0} 10:19:27.351324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Launched 10:19:27.679469 run osmo-hlr_10.42.42.2(pid=25575): Launched 10:19:27.804441 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:28.370128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Launched 10:19:28.699970 run osmo-stp_10.42.42.5(pid=25578): Launched 10:19:28.827281 run osmo-msc_10.42.42.6: Starting osmo-msc 10:19:29.420531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Launched 10:19:29.750694 run osmo-msc_10.42.42.6(pid=25581): Launched 10:19:29.935528 run osmo-stp_10.42.42.5(pid=25578): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] 10:19:30.074052 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-09_10:19:28.639750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:30.212482 run osmo-stp_10.42.42.5(pid=25578): stderr: | 20221209101928833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101928833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101928833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101928834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101928834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101928834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101928834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:30.349452 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-09_10:19:28.639750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:30.480501 run osmo-stp_10.42.42.5(pid=25578): stderr: | 20221209101928833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101928833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101928833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101928834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101928834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101928834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101928834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:30.637366 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:19:30.647435 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:19:30.677039 run osmo-hlr_10.42.42.2(pid=25575): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25575)] 10:19:30.728080 run osmo-hlr_10.42.42.2(pid=25575): stdout: | (launched: 2022-12-09_10:19:27.619317) 10:19:30.780874 run osmo-hlr_10.42.42.2(pid=25575): stderr: | 20221209101927818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101927818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101927818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101927818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101927818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101927818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101927834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101927843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101927843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101927843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:30.862342 run osmo-msc_10.42.42.6(pid=25581): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25581)] 10:19:30.918835 run osmo-msc_10.42.42.6(pid=25581): stdout: | (launched: 2022-12-09_10:19:29.690354) 10:19:30.972289 run osmo-msc_10.42.42.6(pid=25581): stderr: | 20221209101930010 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101930010 DLGLOBAL DEBUG validating counter group 0x7f6bebd01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101930010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101930010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101930011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101930011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101930012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101930013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101930013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101930013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:31.026182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminating (SIGTERM) 10:19:31.069986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminating (SIGTERM) 10:19:31.115545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Terminating (SIGTERM) 10:19:31.161588 --- ParallelTerminationStrategy: PID 25574 died... 10:19:31.182310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminated: ok {rc=0} 10:19:31.231791 --- ParallelTerminationStrategy: PID 25577 died... 10:19:31.252129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminated: ok {rc=0} 10:19:31.300152 --- ParallelTerminationStrategy: PID 25580 died... 10:19:31.320536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Terminated: ok {rc=0} 10:19:31.411397 bus /sierra_3: Setting Powered False 10:19:32.512607 bus /sierra_3: Setting Powered False 10:19:33.629335 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:19:34.780795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:34.793363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:19:34.865376 tst mo_mt_call_osmux.py: using LAC 20786 10:19:34.995025 tst mo_mt_call_osmux.py: using RAC 131 10:19:35.124263 tst mo_mt_call_osmux.py: using CellId 20786 10:19:35.258967 tst mo_mt_call_osmux.py: using BVCI 20787 10:19:35.380182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:35.391995 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:35.403530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:35.415278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:35.427200 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:19:35.439017 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:19:35.557169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:19:35.679299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:36.153722 run create_hlr_db(pid=25584): Launched 10:19:36.279720 bus /sierra_2: Setting Powered False 10:19:37.340083 run create_hlr_db(pid=25584): Terminated: ok {rc=0} 10:19:37.788041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25586): Launched 10:19:38.117675 run osmo-hlr_10.42.42.2(pid=25587): Launched 10:19:38.246390 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:38.817125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25589): Launched 10:19:39.146414 run osmo-stp_10.42.42.5(pid=25590): Launched 10:19:39.270954 run osmo-msc_10.42.42.6: Starting osmo-msc 10:19:39.866279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25592): Launched 10:19:40.195854 run osmo-msc_10.42.42.6(pid=25593): Launched 10:19:40.379778 run osmo-stp_10.42.42.5(pid=25590): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25590)] 10:19:40.518576 run osmo-stp_10.42.42.5(pid=25590): stdout: | (launched: 2022-12-09_10:19:39.085697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:40.658014 run osmo-stp_10.42.42.5(pid=25590): stderr: | 20221209101939277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101939277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101939277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101939278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101939278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101939278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101939278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:40.795513 run osmo-stp_10.42.42.5(pid=25590): stdout: | (launched: 2022-12-09_10:19:39.085697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:40.926521 run osmo-stp_10.42.42.5(pid=25590): stderr: | 20221209101939277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101939277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101939277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101939278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101939278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101939278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101939278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:41.083243 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25590): Process ended prematurely: osmo-stp_10.42.42.5(pid=25590) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25590)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:19:41.093134 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:19:41.122032 run osmo-hlr_10.42.42.2(pid=25587): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25587)] 10:19:41.172926 run osmo-hlr_10.42.42.2(pid=25587): stdout: | (launched: 2022-12-09_10:19:38.057379) 10:19:41.225472 run osmo-hlr_10.42.42.2(pid=25587): stderr: | 20221209101938256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101938256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101938256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101938256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101938256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101938256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101938268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101938278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101938278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101938278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:41.298601 run osmo-msc_10.42.42.6(pid=25593): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25593)] 10:19:41.349240 run osmo-msc_10.42.42.6(pid=25593): stdout: | (launched: 2022-12-09_10:19:40.134817) 10:19:41.401494 run osmo-msc_10.42.42.6(pid=25593): stderr: | 20221209101940457 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101940457 DLGLOBAL DEBUG validating counter group 0x7f620cfdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101940457 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101940457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101940457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101940457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101940459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101940459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101940460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101940460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:41.454415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25586): Terminating (SIGTERM) 10:19:41.496592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25589): Terminating (SIGTERM) 10:19:41.538888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25592): Terminating (SIGTERM) 10:19:41.581501 --- ParallelTerminationStrategy: PID 25586 died... 10:19:41.601568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25586): Terminated: ok {rc=0} 10:19:41.649102 --- ParallelTerminationStrategy: PID 25589 died... 10:19:41.668907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25589): Terminated: ok {rc=0} 10:19:41.715847 --- ParallelTerminationStrategy: PID 25592 died... 10:19:41.735525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25592): Terminated: ok {rc=0} 10:19:41.824365 bus /sierra_3: Setting Powered False 10:19:42.924459 bus /sierra_3: Setting Powered False 10:19:44.042133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:19:45.296660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:19:45.304040 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:19:45.339619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:19:45.367270 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:19:45.421416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:19:45.456450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:19:45.483682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:19:46.059603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:19:46.114999 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:46.127344 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:19:46.199805 tst mo_mt_call.py: using LAC 20787 10:19:46.330518 tst mo_mt_call.py: using RAC 132 10:19:46.500085 tst mo_mt_call.py: using CellId 20787 10:19:46.633364 tst mo_mt_call.py: using BVCI 20788 10:19:46.754130 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:46.766806 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:46.779343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:46.793137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:46.805699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:46.818869 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:19:46.940884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:19:47.064071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:47.551148 run create_hlr_db(pid=25599): Launched 10:19:47.679356 bus /sierra_2: Setting Powered False 10:19:48.739739 run create_hlr_db(pid=25599): Terminated: ok {rc=0} 10:19:49.185438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25601): Launched 10:19:49.514298 run osmo-hlr_10.42.42.2(pid=25602): Launched 10:19:49.641618 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:50.209956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25604): Launched 10:19:50.537681 run osmo-stp_10.42.42.5(pid=25605): Launched 10:19:50.665854 run osmo-msc_10.42.42.6: Starting osmo-msc 10:19:51.263155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25607): Launched 10:19:51.591158 run osmo-msc_10.42.42.6(pid=25608): Launched 10:19:51.776155 run osmo-stp_10.42.42.5(pid=25605): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25605)] 10:19:51.915087 run osmo-stp_10.42.42.5(pid=25605): stdout: | (launched: 2022-12-09_10:19:50.477552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:52.054210 run osmo-stp_10.42.42.5(pid=25605): stderr: | 20221209101950668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101950668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101950669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101950669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101950670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101950670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101950670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:52.191348 run osmo-stp_10.42.42.5(pid=25605): stdout: | (launched: 2022-12-09_10:19:50.477552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:52.322813 run osmo-stp_10.42.42.5(pid=25605): stderr: | 20221209101950668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209101950668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209101950669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209101950669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209101950670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209101950670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209101950670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:52.479226 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25605): Process ended prematurely: osmo-stp_10.42.42.5(pid=25605) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25605)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:19:52.488827 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:19:52.517860 run osmo-hlr_10.42.42.2(pid=25602): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25602)] 10:19:52.568937 run osmo-hlr_10.42.42.2(pid=25602): stdout: | (launched: 2022-12-09_10:19:49.454245) 10:19:52.621318 run osmo-hlr_10.42.42.2(pid=25602): stderr: | 20221209101949653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101949653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101949653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101949653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101949653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101949653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101949668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209101949677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209101949677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209101949677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:52.695063 run osmo-msc_10.42.42.6(pid=25608): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25608)] 10:19:52.745975 run osmo-msc_10.42.42.6(pid=25608): stdout: | (launched: 2022-12-09_10:19:51.530820) 10:19:52.798554 run osmo-msc_10.42.42.6(pid=25608): stderr: | 20221209101951851 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209101951851 DLGLOBAL DEBUG validating counter group 0x7f8271eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209101951852 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209101951852 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209101951852 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209101951852 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209101951854 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209101951854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209101951854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209101951854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:52.851461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25601): Terminating (SIGTERM) 10:19:52.893852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25604): Terminating (SIGTERM) 10:19:52.936341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25607): Terminating (SIGTERM) 10:19:52.979388 --- ParallelTerminationStrategy: PID 25601 died... 10:19:52.999646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25601): Terminated: ok {rc=0} 10:19:53.047036 --- ParallelTerminationStrategy: PID 25604 died... 10:19:53.066796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25604): Terminated: ok {rc=0} 10:19:53.113636 --- ParallelTerminationStrategy: PID 25607 died... 10:19:53.133319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25607): Terminated: ok {rc=0} 10:19:53.221910 bus /sierra_3: Setting Powered False 10:19:54.322818 bus /sierra_3: Setting Powered False 10:19:55.441139 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:19:56.592536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:56.605057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:19:56.678409 tst mo_mt_call_osmux.py: using LAC 20788 10:19:56.813453 tst mo_mt_call_osmux.py: using RAC 133 10:19:56.940747 tst mo_mt_call_osmux.py: using CellId 20788 10:19:57.061408 tst mo_mt_call_osmux.py: using BVCI 20789 10:19:57.174565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:57.185828 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:57.196803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:57.208389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:57.220023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:19:57.231343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:19:57.352665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:19:57.472612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:57.950354 run create_hlr_db(pid=25610): Launched 10:19:58.075801 bus /sierra_2: Setting Powered False 10:19:59.135941 run create_hlr_db(pid=25610): Terminated: ok {rc=0} 10:19:59.560871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25612): Launched 10:19:59.866103 run osmo-hlr_10.42.42.2(pid=25613): Launched 10:19:59.982105 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:00.523227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25615): Launched 10:20:00.829898 run osmo-stp_10.42.42.5(pid=25616): Launched 10:20:01.060230 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:01.956011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25621): Launched 10:20:02.275502 run osmo-msc_10.42.42.6(pid=25622): Launched 10:20:02.549316 run osmo-stp_10.42.42.5(pid=25616): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25616)] 10:20:02.689548 run osmo-stp_10.42.42.5(pid=25616): stdout: | (launched: 2022-12-09_10:20:00.772133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:02.831103 run osmo-stp_10.42.42.5(pid=25616): stderr: | 20221209102001060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102001060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102001060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102001061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102001061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102001061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102001061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:02.970101 run osmo-stp_10.42.42.5(pid=25616): stdout: | (launched: 2022-12-09_10:20:00.772133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:03.101543 run osmo-stp_10.42.42.5(pid=25616): stderr: | 20221209102001060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102001060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102001060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102001061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102001061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102001061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102001061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:03.258457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25616): Process ended prematurely: osmo-stp_10.42.42.5(pid=25616) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25616)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:20:03.268343 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 10:20:03.298007 run osmo-hlr_10.42.42.2(pid=25613): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25613)] 10:20:03.349766 run osmo-hlr_10.42.42.2(pid=25613): stdout: | (launched: 2022-12-09_10:19:59.809530) 10:20:03.403378 run osmo-hlr_10.42.42.2(pid=25613): stderr: | 20221209101959986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209101959986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209101959986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209101959986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209101959986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209101959987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209101959999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102000008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102000008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102000008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:03.477594 run osmo-msc_10.42.42.6(pid=25622): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25622)] 10:20:03.529281 run osmo-msc_10.42.42.6(pid=25622): stdout: | (launched: 2022-12-09_10:20:02.216622) 10:20:03.582502 run osmo-msc_10.42.42.6(pid=25622): stderr: | 20221209102002655 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102002655 DLGLOBAL DEBUG validating counter group 0x7fded6145c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102002655 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102002655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102002655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102002655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102002657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102002657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102002658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102002658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:03.636289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25612): Terminating (SIGTERM) 10:20:03.679944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25615): Terminating (SIGTERM) 10:20:03.723132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25621): Terminating (SIGTERM) 10:20:03.766354 --- ParallelTerminationStrategy: PID 25612 died... 10:20:03.786600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25612): Terminated: ok {rc=0} 10:20:03.834905 --- ParallelTerminationStrategy: PID 25615 died... 10:20:03.854611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25615): Terminated: ok {rc=0} 10:20:03.902729 --- ParallelTerminationStrategy: PID 25621 died... 10:20:03.922482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25621): Terminated: ok {rc=0} 10:20:04.012717 bus /sierra_3: Setting Powered False 10:20:05.110396 bus /sierra_3: Setting Powered False 10:20:06.226270 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:20:07.480705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:07.487243 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:20:07.520568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:20:07.546857 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:20:07.599720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:20:07.633149 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:20:07.659296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:20:08.209540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:20:08.265936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:08.277904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:20:08.350659 tst mo_mt_call.py: using LAC 20789 10:20:08.481430 tst mo_mt_call.py: using RAC 134 10:20:08.610916 tst mo_mt_call.py: using CellId 20789 10:20:08.741931 tst mo_mt_call.py: using BVCI 20790 10:20:08.860888 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:08.872717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:08.884167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:08.895977 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:08.907787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:08.919472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:20:09.038052 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:20:09.155619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:09.665484 run create_hlr_db(pid=25627): Launched 10:20:09.792563 bus /sierra_2: Setting Powered False 10:20:10.856362 run create_hlr_db(pid=25627): Terminated: ok {rc=0} 10:20:11.291500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Launched 10:20:11.597658 run osmo-hlr_10.42.42.2(pid=25630): Launched 10:20:11.715783 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:12.257561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Launched 10:20:12.566226 run osmo-stp_10.42.42.5(pid=25633): Launched 10:20:12.682726 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:13.237740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25635): Launched 10:20:13.546106 run osmo-msc_10.42.42.6(pid=25636): Launched 10:20:13.718224 run osmo-stp_10.42.42.5(pid=25633): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] 10:20:13.847331 run osmo-stp_10.42.42.5(pid=25633): stdout: | (launched: 2022-12-09_10:20:12.509281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:13.976356 run osmo-stp_10.42.42.5(pid=25633): stderr: | 20221209102012679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102012679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102012680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102012680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102012681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102012681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102012681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:14.103844 run osmo-stp_10.42.42.5(pid=25633): stdout: | (launched: 2022-12-09_10:20:12.509281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:14.225569 run osmo-stp_10.42.42.5(pid=25633): stderr: | 20221209102012679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102012679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102012680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102012680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102012681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102012681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102012681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:14.371331 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25633): Process ended prematurely: osmo-stp_10.42.42.5(pid=25633) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:20:14.380284 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:20:14.406958 run osmo-hlr_10.42.42.2(pid=25630): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25630)] 10:20:14.454961 run osmo-hlr_10.42.42.2(pid=25630): stdout: | (launched: 2022-12-09_10:20:11.540787) 10:20:14.504365 run osmo-hlr_10.42.42.2(pid=25630): stderr: | 20221209102011718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102011718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102011718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102011718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102011718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102011718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102011731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102011742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102011742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102011742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:14.573382 run osmo-msc_10.42.42.6(pid=25636): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25636)] 10:20:14.620789 run osmo-msc_10.42.42.6(pid=25636): stdout: | (launched: 2022-12-09_10:20:13.488872) 10:20:14.670049 run osmo-msc_10.42.42.6(pid=25636): stderr: | 20221209102013762 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102013762 DLGLOBAL DEBUG validating counter group 0x7f0664b60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102013762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102013762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102013762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102013762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102013764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102013764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102013765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102013765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:14.719785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Terminating (SIGTERM) 10:20:14.759649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Terminating (SIGTERM) 10:20:14.799321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25635): Terminating (SIGTERM) 10:20:14.839415 --- ParallelTerminationStrategy: PID 25629 died... 10:20:14.858519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Terminated: ok {rc=0} 10:20:14.902457 --- ParallelTerminationStrategy: PID 25632 died... 10:20:14.921076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Terminated: ok {rc=0} 10:20:14.964928 --- ParallelTerminationStrategy: PID 25635 died... 10:20:14.983908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25635): Terminated: ok {rc=0} 10:20:15.068750 bus /sierra_3: Setting Powered False 10:20:16.171384 bus /sierra_3: Setting Powered False 10:20:17.289556 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:20:18.438853 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:18.450982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:20:18.521772 tst mo_mt_call_osmux.py: using LAC 20790 10:20:18.643861 tst mo_mt_call_osmux.py: using RAC 135 10:20:18.765426 tst mo_mt_call_osmux.py: using CellId 20790 10:20:18.885428 tst mo_mt_call_osmux.py: using BVCI 20791 10:20:18.995637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:19.006924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:19.017993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:19.029689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:19.041231 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:20:19.052629 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:20:19.168844 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:20:19.290425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:19.800108 run create_hlr_db(pid=25638): Launched 10:20:19.927398 bus /sierra_2: Setting Powered False 10:20:20.988585 run create_hlr_db(pid=25638): Terminated: ok {rc=0} 10:20:21.425547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Launched 10:20:21.735292 run osmo-hlr_10.42.42.2(pid=25641): Launched 10:20:21.852392 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:22.396170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Launched 10:20:22.702564 run osmo-stp_10.42.42.5(pid=25644): Launched 10:20:22.821817 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:23.375733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Launched 10:20:23.682490 run osmo-msc_10.42.42.6(pid=25647): Launched 10:20:23.854292 run osmo-stp_10.42.42.5(pid=25644): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] 10:20:23.982480 run osmo-stp_10.42.42.5(pid=25644): stdout: | (launched: 2022-12-09_10:20:22.645727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:24.110766 run osmo-stp_10.42.42.5(pid=25644): stderr: | 20221209102022816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102022817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102022817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102022817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102022818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102022818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102022818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:24.236930 run osmo-stp_10.42.42.5(pid=25644): stdout: | (launched: 2022-12-09_10:20:22.645727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:24.357994 run osmo-stp_10.42.42.5(pid=25644): stderr: | 20221209102022816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102022817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102022817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102022817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102022818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102022818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102022818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:24.503314 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25644): Process ended prematurely: osmo-stp_10.42.42.5(pid=25644) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:20:24.512452 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:20:24.539345 run osmo-hlr_10.42.42.2(pid=25641): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25641)] 10:20:24.587288 run osmo-hlr_10.42.42.2(pid=25641): stdout: | (launched: 2022-12-09_10:20:21.678131) 10:20:24.637250 run osmo-hlr_10.42.42.2(pid=25641): stderr: | 20221209102021854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102021854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102021854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102021854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102021855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102021855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102021867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102021875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102021875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102021875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:24.706920 run osmo-msc_10.42.42.6(pid=25647): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25647)] 10:20:24.755003 run osmo-msc_10.42.42.6(pid=25647): stdout: | (launched: 2022-12-09_10:20:23.625759) 10:20:24.804447 run osmo-msc_10.42.42.6(pid=25647): stderr: | 20221209102023896 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102023896 DLGLOBAL DEBUG validating counter group 0x7fe524f9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102023896 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102023897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102023897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102023897 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102023899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102023899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102023899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102023899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:24.854574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Terminating (SIGTERM) 10:20:24.894265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Terminating (SIGTERM) 10:20:24.934029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Terminating (SIGTERM) 10:20:24.973927 --- ParallelTerminationStrategy: PID 25640 died... 10:20:24.993253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Terminated: ok {rc=0} 10:20:25.037387 --- ParallelTerminationStrategy: PID 25643 died... 10:20:25.056074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Terminated: ok {rc=0} 10:20:25.099886 --- ParallelTerminationStrategy: PID 25646 died... 10:20:25.118555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Terminated: ok {rc=0} 10:20:25.205950 bus /sierra_3: Setting Powered False 10:20:26.306477 bus /sierra_3: Setting Powered False 10:20:27.421778 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:20:28.684246 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:28.691637 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:20:28.726691 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:20:28.754011 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:20:28.808043 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:20:28.842627 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:20:28.869906 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:20:29.422834 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:20:29.475579 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:29.487497 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:20:29.560387 tst mo_mt_call.py: using LAC 20791 10:20:29.690611 tst mo_mt_call.py: using RAC 136 10:20:29.818726 tst mo_mt_call.py: using CellId 20791 10:20:29.946830 tst mo_mt_call.py: using BVCI 20792 10:20:30.067387 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:30.079266 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:30.090793 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:30.102635 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:30.114729 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:30.126998 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:20:30.245961 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:20:30.365774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:30.885283 run create_hlr_db(pid=25652): Launched 10:20:31.045749 bus /sierra_2: Setting Powered False 10:20:32.109884 run create_hlr_db(pid=25652): Terminated: ok {rc=0} 10:20:32.569610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Launched 10:20:32.899931 run osmo-hlr_10.42.42.2(pid=25655): Launched 10:20:33.026100 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:33.591206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Launched 10:20:33.922950 run osmo-stp_10.42.42.5(pid=25658): Launched 10:20:34.049702 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:34.643224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Launched 10:20:34.971532 run osmo-msc_10.42.42.6(pid=25661): Launched 10:20:35.156424 run osmo-stp_10.42.42.5(pid=25658): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] 10:20:35.294723 run osmo-stp_10.42.42.5(pid=25658): stdout: | (launched: 2022-12-09_10:20:33.862467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:35.433313 run osmo-stp_10.42.42.5(pid=25658): stderr: | 20221209102034054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102034054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102034055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102034055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102034055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102034055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102034056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:35.570021 run osmo-stp_10.42.42.5(pid=25658): stdout: | (launched: 2022-12-09_10:20:33.862467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:35.701118 run osmo-stp_10.42.42.5(pid=25658): stderr: | 20221209102034054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102034054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102034055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102034055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102034055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102034055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102034056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:35.857115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25658): Process ended prematurely: osmo-stp_10.42.42.5(pid=25658) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:20:35.866918 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:20:35.895942 run osmo-hlr_10.42.42.2(pid=25655): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25655)] 10:20:35.946686 run osmo-hlr_10.42.42.2(pid=25655): stdout: | (launched: 2022-12-09_10:20:32.839547) 10:20:35.999094 run osmo-hlr_10.42.42.2(pid=25655): stderr: | 20221209102033036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102033036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102033037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102033037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102033037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102033037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102033050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102033058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102033058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102033059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:36.072169 run osmo-msc_10.42.42.6(pid=25661): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25661)] 10:20:36.122856 run osmo-msc_10.42.42.6(pid=25661): stdout: | (launched: 2022-12-09_10:20:34.911476) 10:20:36.175195 run osmo-msc_10.42.42.6(pid=25661): stderr: | 20221209102035231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102035231 DLGLOBAL DEBUG validating counter group 0x7f0211a3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102035231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102035232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102035232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102035232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102035234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102035234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102035234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102035234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:36.227938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Terminating (SIGTERM) 10:20:36.269997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Terminating (SIGTERM) 10:20:36.312286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Terminating (SIGTERM) 10:20:36.354811 --- ParallelTerminationStrategy: PID 25654 died... 10:20:36.375017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Terminated: ok {rc=0} 10:20:36.421981 --- ParallelTerminationStrategy: PID 25657 died... 10:20:36.441514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Terminated: ok {rc=0} 10:20:36.488187 --- ParallelTerminationStrategy: PID 25660 died... 10:20:36.507749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Terminated: ok {rc=0} 10:20:36.596629 bus /sierra_3: Setting Powered False 10:20:37.696367 bus /sierra_3: Setting Powered False 10:20:38.813607 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:20:39.965640 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:39.978011 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:20:40.051880 tst mo_mt_call_osmux.py: using LAC 20792 10:20:40.181404 tst mo_mt_call_osmux.py: using RAC 137 10:20:40.308491 tst mo_mt_call_osmux.py: using CellId 20792 10:20:40.440814 tst mo_mt_call_osmux.py: using BVCI 20793 10:20:40.562121 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:40.573876 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:40.585408 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:40.597716 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:40.610038 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:20:40.622423 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:20:40.745354 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:20:40.862216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:41.339536 run create_hlr_db(pid=25663): Launched 10:20:41.466366 bus /sierra_2: Setting Powered False 10:20:42.527279 run create_hlr_db(pid=25663): Terminated: ok {rc=0} 10:20:42.974736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Launched 10:20:43.301992 run osmo-hlr_10.42.42.2(pid=25666): Launched 10:20:43.428891 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:43.993039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Launched 10:20:44.319952 run osmo-stp_10.42.42.5(pid=25669): Launched 10:20:44.444645 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:45.039081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25671): Launched 10:20:45.366719 run osmo-msc_10.42.42.6(pid=25672): Launched 10:20:45.551565 run osmo-stp_10.42.42.5(pid=25669): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] 10:20:45.691255 run osmo-stp_10.42.42.5(pid=25669): stdout: | (launched: 2022-12-09_10:20:44.259958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:45.830566 run osmo-stp_10.42.42.5(pid=25669): stderr: | 20221209102044449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102044449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102044450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102044450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102044450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102044451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102044451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:45.994678 run osmo-stp_10.42.42.5(pid=25669): stdout: | (launched: 2022-12-09_10:20:44.259958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:46.119992 run osmo-stp_10.42.42.5(pid=25669): stderr: | 20221209102044449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102044449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102044450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102044450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102044450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102044451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102044451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:46.270282 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25669): Process ended prematurely: osmo-stp_10.42.42.5(pid=25669) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:20:46.280478 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:20:46.309082 run osmo-hlr_10.42.42.2(pid=25666): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25666)] 10:20:46.359905 run osmo-hlr_10.42.42.2(pid=25666): stdout: | (launched: 2022-12-09_10:20:43.241969) 10:20:46.411841 run osmo-hlr_10.42.42.2(pid=25666): stderr: | 20221209102043439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102043439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102043439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102043439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102043439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102043439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102043451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102043462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102043462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102043462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:46.484049 run osmo-msc_10.42.42.6(pid=25672): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25672)] 10:20:46.534020 run osmo-msc_10.42.42.6(pid=25672): stdout: | (launched: 2022-12-09_10:20:45.306293) 10:20:46.586503 run osmo-msc_10.42.42.6(pid=25672): stderr: | 20221209102045628 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102045628 DLGLOBAL DEBUG validating counter group 0x7fc8cc7c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102045628 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102045628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102045628 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102045628 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102045630 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102045630 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102045631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102045631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:46.638035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Terminating (SIGTERM) 10:20:46.680746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Terminating (SIGTERM) 10:20:46.725817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25671): Terminating (SIGTERM) 10:20:46.772860 --- ParallelTerminationStrategy: PID 25665 died... 10:20:46.793298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Terminated: ok {rc=0} 10:20:46.841035 --- ParallelTerminationStrategy: PID 25668 died... 10:20:46.860661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Terminated: ok {rc=0} 10:20:46.906528 --- ParallelTerminationStrategy: PID 25671 died... 10:20:46.926496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25671): Terminated: ok {rc=0} 10:20:47.019544 bus /sierra_3: Setting Powered False 10:20:48.126617 bus /sierra_3: Setting Powered False 10:20:49.239970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:20:50.490391 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:50.496185 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:20:50.529826 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:20:50.556172 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:20:50.607916 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:20:50.641295 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:20:50.667656 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:20:51.217916 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:20:51.274360 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:20:51.285807 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:20:51.359377 tst mo_mt_call.py: using LAC 20793 10:20:51.492354 tst mo_mt_call.py: using RAC 138 10:20:51.612521 tst mo_mt_call.py: using CellId 20793 10:20:51.730612 tst mo_mt_call.py: using BVCI 20794 10:20:51.843353 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:20:51.854532 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:20:51.865610 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:20:51.876752 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:20:51.887932 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:20:51.898940 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:20:52.017813 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:20:52.138215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:52.645737 run create_hlr_db(pid=25677): Launched 10:20:52.774066 bus /sierra_2: Setting Powered False 10:20:53.838296 run create_hlr_db(pid=25677): Terminated: ok {rc=0} 10:20:54.274827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25679): Launched 10:20:54.581697 run osmo-hlr_10.42.42.2(pid=25680): Launched 10:20:54.699771 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:55.230929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25682): Launched 10:20:55.541291 run osmo-stp_10.42.42.5(pid=25683): Launched 10:20:55.669423 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:56.266713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25685): Launched 10:20:56.597486 run osmo-msc_10.42.42.6(pid=25686): Launched 10:20:56.783816 run osmo-stp_10.42.42.5(pid=25683): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25683)] 10:20:56.921939 run osmo-stp_10.42.42.5(pid=25683): stdout: | (launched: 2022-12-09_10:20:55.483038) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:57.060640 run osmo-stp_10.42.42.5(pid=25683): stderr: | 20221209102055670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102055670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102055670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102055670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102055671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102055671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102055671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:57.198902 run osmo-stp_10.42.42.5(pid=25683): stdout: | (launched: 2022-12-09_10:20:55.483038) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:57.330732 run osmo-stp_10.42.42.5(pid=25683): stderr: | 20221209102055670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102055670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102055670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102055670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102055671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102055671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102055671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:57.488586 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25683): Process ended prematurely: osmo-stp_10.42.42.5(pid=25683) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25683)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:20:57.498586 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:20:57.527480 run osmo-hlr_10.42.42.2(pid=25680): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25680)] 10:20:57.579677 run osmo-hlr_10.42.42.2(pid=25680): stdout: | (launched: 2022-12-09_10:20:54.525188) 10:20:57.632849 run osmo-hlr_10.42.42.2(pid=25680): stderr: | 20221209102054700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102054700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102054700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102054700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102054700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102054700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102054712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102054720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102054720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102054720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:57.706955 run osmo-msc_10.42.42.6(pid=25686): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25686)] 10:20:57.758718 run osmo-msc_10.42.42.6(pid=25686): stdout: | (launched: 2022-12-09_10:20:56.537103) 10:20:57.812267 run osmo-msc_10.42.42.6(pid=25686): stderr: | 20221209102056861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102056861 DLGLOBAL DEBUG validating counter group 0x7fa8dac53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102056861 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102056861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102056861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102056862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102056863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102056864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102056864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102056864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:57.865977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25679): Terminating (SIGTERM) 10:20:57.909030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25682): Terminating (SIGTERM) 10:20:57.951934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25685): Terminating (SIGTERM) 10:20:57.995170 --- ParallelTerminationStrategy: PID 25679 died... 10:20:58.015398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25679): Terminated: ok {rc=0} 10:20:58.063583 --- ParallelTerminationStrategy: PID 25682 died... 10:20:58.083446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25682): Terminated: ok {rc=0} 10:20:58.131781 --- ParallelTerminationStrategy: PID 25685 died... 10:20:58.151614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25685): Terminated: ok {rc=0} 10:20:58.242782 bus /sierra_3: Setting Powered False 10:20:59.342629 bus /sierra_3: Setting Powered False 10:21:00.460339 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:21:01.612829 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:21:01.626231 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:21:01.702217 tst mo_mt_call_osmux.py: using LAC 20794 10:21:01.849584 tst mo_mt_call_osmux.py: using RAC 139 10:21:01.973330 tst mo_mt_call_osmux.py: using CellId 20794 10:21:02.121398 tst mo_mt_call_osmux.py: using BVCI 20795 10:21:02.247232 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:21:02.258925 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:21:02.270504 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:21:02.281804 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:21:02.293156 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:21:02.304231 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:21:02.420684 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:21:02.546464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:03.057394 run create_hlr_db(pid=25688): Launched 10:21:03.182550 bus /sierra_2: Setting Powered False 10:21:04.247807 run create_hlr_db(pid=25688): Terminated: ok {rc=0} 10:21:04.683416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25690): Launched 10:21:04.991497 run osmo-hlr_10.42.42.2(pid=25691): Launched 10:21:05.107556 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:05.649059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25693): Launched 10:21:05.955282 run osmo-stp_10.42.42.5(pid=25694): Launched 10:21:06.072079 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:06.627201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25696): Launched 10:21:06.934840 run osmo-msc_10.42.42.6(pid=25697): Launched 10:21:07.107689 run osmo-stp_10.42.42.5(pid=25694): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25694)] 10:21:07.236113 run osmo-stp_10.42.42.5(pid=25694): stdout: | (launched: 2022-12-09_10:21:05.898803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:07.364674 run osmo-stp_10.42.42.5(pid=25694): stderr: | 20221209102106069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102106069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102106069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102106069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102106070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102106070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102106070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:07.491874 run osmo-stp_10.42.42.5(pid=25694): stdout: | (launched: 2022-12-09_10:21:05.898803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:07.613783 run osmo-stp_10.42.42.5(pid=25694): stderr: | 20221209102106069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102106069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102106069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102106069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102106070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102106070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102106070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:07.759928 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25694): Process ended prematurely: osmo-stp_10.42.42.5(pid=25694) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25694)] [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:21:07.769236 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:21:07.796324 run osmo-hlr_10.42.42.2(pid=25691): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25691)] 10:21:07.844652 run osmo-hlr_10.42.42.2(pid=25691): stdout: | (launched: 2022-12-09_10:21:04.935090) 10:21:07.894621 run osmo-hlr_10.42.42.2(pid=25691): stderr: | 20221209102105110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102105110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102105110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102105110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102105110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102105110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102105121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102105129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102105130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102105130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:07.964097 run osmo-msc_10.42.42.6(pid=25697): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25697)] 10:21:08.011840 run osmo-msc_10.42.42.6(pid=25697): stdout: | (launched: 2022-12-09_10:21:06.877760) 10:21:08.061392 run osmo-msc_10.42.42.6(pid=25697): stderr: | 20221209102107151 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102107151 DLGLOBAL DEBUG validating counter group 0x7f7b57a90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102107151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102107151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102107151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102107151 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102107153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102107154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102107154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102107154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:08.111337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25690): Terminating (SIGTERM) 10:21:08.151284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25693): Terminating (SIGTERM) 10:21:08.191419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25696): Terminating (SIGTERM) 10:21:08.231913 --- ParallelTerminationStrategy: PID 25690 died... 10:21:08.251246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25690): Terminated: ok {rc=0} 10:21:08.295996 --- ParallelTerminationStrategy: PID 25693 died... 10:21:08.314927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25693): Terminated: ok {rc=0} 10:21:08.359388 --- ParallelTerminationStrategy: PID 25696 died... 10:21:08.378146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25696): Terminated: ok {rc=0} 10:21:08.462131 bus /sierra_3: Setting Powered False 10:21:09.562341 bus /sierra_3: Setting Powered False 10:21:10.679769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 10:21:11.926511 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:21:11.930954 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:21:11.964664 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:21:11.990875 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:21:12.074860 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:21:12.108484 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:21:12.134605 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:21:12.724200 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 10:21:12.730416 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:12.741586 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:21:12.791282 tst emergency_mo_mt_call.py: using LAC 20795 10:21:12.910654 tst emergency_mo_mt_call.py: using RAC 140 10:21:13.027920 tst emergency_mo_mt_call.py: using CellId 20795 10:21:13.147120 tst emergency_mo_mt_call.py: using BVCI 20796 10:21:13.256434 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:13.267342 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:13.277970 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:13.288443 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:13.299012 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:13.309636 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:13.430208 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:13.546007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:14.012359 run create_hlr_db(pid=25703): Launched 10:21:14.136087 bus /sierra_2: Setting Powered False 10:21:15.196161 run create_hlr_db(pid=25703): Terminated: ok {rc=0} 10:21:15.636897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25705): Launched 10:21:15.973663 run osmo-hlr_10.42.42.2(pid=25706): Launched 10:21:16.214263 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:16.912710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25708): Launched 10:21:17.225506 run osmo-stp_10.42.42.5(pid=25709): Launched 10:21:17.352209 tst emergency_mo_mt_call.py: using MSISDN 7158 10:21:17.516186 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:18.059713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25711): Launched 10:21:18.359461 run osmo-msc_10.42.42.6(pid=25712): Launched 10:21:18.527028 run osmo-stp_10.42.42.5(pid=25709): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25709)] 10:21:18.653438 run osmo-stp_10.42.42.5(pid=25709): stdout: | (launched: 2022-12-09_10:21:17.169127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:18.779492 run osmo-stp_10.42.42.5(pid=25709): stderr: | 20221209102117338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102117338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102117338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102117339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102117339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102117339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102117339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:18.903952 run osmo-stp_10.42.42.5(pid=25709): stdout: | (launched: 2022-12-09_10:21:17.169127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:19.023469 run osmo-stp_10.42.42.5(pid=25709): stderr: | 20221209102117338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102117338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102117338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102117339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102117339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102117339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102117339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:19.165856 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25709): Process ended prematurely: osmo-stp_10.42.42.5(pid=25709) [trial-2358↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25709)] [trial-2358↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 10:21:19.174420 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 10:21:19.200812 run osmo-hlr_10.42.42.2(pid=25706): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25706)] 10:21:19.249281 run osmo-hlr_10.42.42.2(pid=25706): stdout: | (launched: 2022-12-09_10:21:15.915682) 10:21:19.299078 run osmo-hlr_10.42.42.2(pid=25706): stderr: | 20221209102116231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102116232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102116232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102116232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102116232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102116232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102116250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102116258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102116258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102116259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:19.368936 run osmo-msc_10.42.42.6(pid=25712): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25712)] 10:21:19.417174 run osmo-msc_10.42.42.6(pid=25712): stdout: | (launched: 2022-12-09_10:21:18.303690) 10:21:19.466572 run osmo-msc_10.42.42.6(pid=25712): stderr: | 20221209102118574 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102118574 DLGLOBAL DEBUG validating counter group 0x7f1881ff8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102118574 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102118574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102118575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102118575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102118577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102118578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102118578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102118578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:19.516455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25705): Terminating (SIGTERM) 10:21:19.556726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25708): Terminating (SIGTERM) 10:21:19.596816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25711): Terminating (SIGTERM) 10:21:19.637333 --- ParallelTerminationStrategy: PID 25705 died... 10:21:19.656735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25705): Terminated: ok {rc=0} 10:21:19.701446 --- ParallelTerminationStrategy: PID 25708 died... 10:21:19.720228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25708): Terminated: ok {rc=0} 10:21:19.764563 --- ParallelTerminationStrategy: PID 25711 died... 10:21:19.783500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25711): Terminated: ok {rc=0} 10:21:19.868774 bus /sierra_3: Setting Powered False 10:21:20.966574 bus /sierra_3: Setting Powered False 10:21:22.079383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 10:21:23.163903 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:23.175443 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:21:23.227121 tst emergency_preemptive_call.py: using LAC 20796 10:21:23.345706 tst emergency_preemptive_call.py: using RAC 141 10:21:23.466819 tst emergency_preemptive_call.py: using CellId 20796 10:21:23.584012 tst emergency_preemptive_call.py: using BVCI 20797 10:21:23.691495 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:23.702549 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:23.713337 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:23.723860 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:23.734481 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:21:23.745232 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:23.859570 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:23.975186 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:24.093243 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:24.211504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:24.712068 run create_hlr_db(pid=25714): Launched 10:21:24.836879 bus /sierra_2: Setting Powered False 10:21:25.900266 run create_hlr_db(pid=25714): Terminated: ok {rc=0} 10:21:26.348176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25716): Launched 10:21:26.672342 run osmo-hlr_10.42.42.2(pid=25717): Launched 10:21:26.798381 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:27.355620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25719): Launched 10:21:27.679644 run osmo-stp_10.42.42.5(pid=25720): Launched 10:21:27.815245 tst emergency_preemptive_call.py: using MSISDN 7159 10:21:27.985482 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:28.564425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25722): Launched 10:21:28.889649 run osmo-msc_10.42.42.6(pid=25723): Launched 10:21:29.071529 run osmo-stp_10.42.42.5(pid=25720): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25720)] 10:21:29.207391 run osmo-stp_10.42.42.5(pid=25720): stdout: | (launched: 2022-12-09_10:21:27.620159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:29.343709 run osmo-stp_10.42.42.5(pid=25720): stderr: | 20221209102127812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102127813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102127813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102127813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102127814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102127814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102127814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:29.479617 run osmo-stp_10.42.42.5(pid=25720): stdout: | (launched: 2022-12-09_10:21:27.620159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:29.608116 run osmo-stp_10.42.42.5(pid=25720): stderr: | 20221209102127812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102127813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102127813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102127813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102127814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102127814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102127814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:29.762264 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25720): Process ended prematurely: osmo-stp_10.42.42.5(pid=25720) [trial-2358↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25720)] [trial-2358↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 10:21:29.771433 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 10:21:29.800484 run osmo-hlr_10.42.42.2(pid=25717): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25717)] 10:21:29.851833 run osmo-hlr_10.42.42.2(pid=25717): stdout: | (launched: 2022-12-09_10:21:26.612871) 10:21:29.904746 run osmo-hlr_10.42.42.2(pid=25717): stderr: | 20221209102126811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102126811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102126811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102126811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102126811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102126811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102126824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102126832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102126832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102126832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:29.978797 run osmo-msc_10.42.42.6(pid=25723): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25723)] 10:21:30.030088 run osmo-msc_10.42.42.6(pid=25723): stdout: | (launched: 2022-12-09_10:21:28.830085) 10:21:30.082879 run osmo-msc_10.42.42.6(pid=25723): stderr: | 20221209102129154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102129154 DLGLOBAL DEBUG validating counter group 0x7f0962e44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102129154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102129154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102129154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102129154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102129156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102129157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102129157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102129157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:30.136026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25716): Terminating (SIGTERM) 10:21:30.178486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25719): Terminating (SIGTERM) 10:21:30.221090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25722): Terminating (SIGTERM) 10:21:30.263714 --- ParallelTerminationStrategy: PID 25716 died... 10:21:30.283752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25716): Terminated: ok {rc=0} 10:21:30.330980 --- ParallelTerminationStrategy: PID 25719 died... 10:21:30.350762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25719): Terminated: ok {rc=0} 10:21:30.397575 --- ParallelTerminationStrategy: PID 25722 died... 10:21:30.417267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25722): Terminated: ok {rc=0} 10:21:30.506272 bus /sierra_9: Setting Powered False 10:21:31.605249 bus /sierra_9: Setting Powered False 10:21:32.723777 bus /sierra_8: Setting Powered False 10:21:33.823941 bus /sierra_8: Setting Powered False 10:21:34.941185 bus /sierra_3: Setting Powered False 10:21:36.040749 bus /sierra_3: Setting Powered False 10:21:37.158180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 10:21:38.437555 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:21:38.441980 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:21:38.475382 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 10:21:38.513055 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:21:38.599356 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:21:38.632248 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 10:21:38.670199 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:21:39.261891 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 10:21:39.317374 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.328514 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:21:39.379328 tst cs_paging_gprs_active.py: using LAC 20797 10:21:39.510085 tst cs_paging_gprs_active.py: using RAC 142 10:21:39.641048 tst cs_paging_gprs_active.py: using CellId 20797 10:21:39.766650 tst cs_paging_gprs_active.py: using BVCI 20798 10:21:39.879202 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.890135 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.900781 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.911528 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.922202 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.932748 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.943370 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.954759 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:39.965564 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:40.083910 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:40.200590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:21:40.406161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:40.713689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25728): Launched 10:21:40.982682 run iperf3-srv_10.42.42.10(pid=25729): Launched 10:21:41.100698 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:21:41.305147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:41.613062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25730): Launched 10:21:41.879950 run iperf3-srv_10.42.42.10(pid=25731): Launched 10:21:41.995591 tst cs_paging_gprs_active.py:38: start network... 10:21:42.199519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:42.675631 run create_hlr_db(pid=25732): Launched 10:21:42.803011 bus /sierra_2: Setting Powered False 10:21:43.863948 run create_hlr_db(pid=25732): Terminated: ok {rc=0} 10:21:44.312205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25734): Launched 10:21:44.643492 run osmo-hlr_10.42.42.2(pid=25735): Launched 10:21:44.772236 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:45.343665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25737): Launched 10:21:45.674755 run osmo-stp_10.42.42.5(pid=25738): Launched 10:21:45.803314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:46.440053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25740): Launched 10:21:46.581678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:46.869792 run patchelf(pid=25741): Launched 10:21:47.067583 run osmo-stp_10.42.42.5(pid=25738): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25738)] 10:21:47.210433 run osmo-stp_10.42.42.5(pid=25738): stdout: | (launched: 2022-12-09_10:21:45.614076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:47.353190 run osmo-stp_10.42.42.5(pid=25738): stderr: | 20221209102145805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102145805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102145805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102145805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102145806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102145806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102145806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:47.494293 run osmo-stp_10.42.42.5(pid=25738): stdout: | (launched: 2022-12-09_10:21:45.614076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:47.629675 run osmo-stp_10.42.42.5(pid=25738): stderr: | 20221209102145805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102145805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102145805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102145805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102145806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102145806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102145806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:47.791343 run patchelf(pid=25741): Terminating (SIGINT) 10:21:47.975991 run patchelf(pid=25741): Terminated: ok {rc=0} 10:21:48.109348 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25738): Process ended prematurely: osmo-stp_10.42.42.5(pid=25738) [trial-2358↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25738)] [trial-2358↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 10:21:48.119931 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:21:48.149929 run osmo-hlr_10.42.42.2(pid=25735): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25735)] 10:21:48.201484 run osmo-hlr_10.42.42.2(pid=25735): stdout: | (launched: 2022-12-09_10:21:44.583136) 10:21:48.254599 run osmo-hlr_10.42.42.2(pid=25735): stderr: | 20221209102144783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102144783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102144783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102144783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102144783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102144783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102144796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102144804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102144805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102144805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:48.307978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25728): Terminating (SIGTERM) 10:21:48.351053 run iperf3-srv_10.42.42.10(pid=25729): Terminating (SIGTERM) 10:21:48.393908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25730): Terminating (SIGTERM) 10:21:48.436692 run iperf3-srv_10.42.42.10(pid=25731): Terminating (SIGTERM) 10:21:48.479379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25734): Terminating (SIGTERM) 10:21:48.521906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25737): Terminating (SIGTERM) 10:21:48.565026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25740): Terminating (SIGTERM) 10:21:48.608024 --- ParallelTerminationStrategy: PID 25728 died... 10:21:48.627949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25728): Terminated: ok {rc=0} 10:21:48.675416 --- ParallelTerminationStrategy: PID 25729 died... 10:21:48.695224 run iperf3-srv_10.42.42.10(pid=25729): Terminated {rc=256} 10:21:48.742796 --- ParallelTerminationStrategy: PID 25730 died... 10:21:48.762770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25730): Terminated: ok {rc=0} 10:21:48.810055 --- ParallelTerminationStrategy: PID 25731 died... 10:21:48.829902 run iperf3-srv_10.42.42.10(pid=25731): Terminated {rc=256} 10:21:48.877040 --- ParallelTerminationStrategy: PID 25734 died... 10:21:48.896759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25734): Terminated: ok {rc=0} 10:21:48.943958 --- ParallelTerminationStrategy: PID 25737 died... 10:21:48.963880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25737): Terminated: ok {rc=0} 10:21:49.011075 --- ParallelTerminationStrategy: PID 25740 died... 10:21:49.031029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25740): Terminated: ok {rc=0} 10:21:49.121365 bus /gobi_0: Setting Powered False 10:21:50.222205 bus /gobi_0: Setting Powered False 10:21:51.339048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 10:21:52.490850 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:52.502634 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:21:52.557435 tst iperf3.py: using LAC 20798 10:21:52.687078 tst iperf3.py: using RAC 143 10:21:52.815857 tst iperf3.py: using CellId 20798 10:21:52.944744 tst iperf3.py: using BVCI 20799 10:21:53.057578 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.068399 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.079039 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.090507 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.101952 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.113090 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.124334 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.135498 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:21:53.146890 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:21:53.267886 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:21:53.490669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:53.820439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25742): Launched 10:21:54.107866 run iperf3-srv_10.42.42.10(pid=25743): Launched 10:21:54.232826 tst iperf3.py:8: start network... 10:21:54.452862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:54.963500 run create_hlr_db(pid=25744): Launched 10:21:55.089278 bus /gobi_6: Setting Powered False 10:21:56.154051 run create_hlr_db(pid=25744): Terminated: ok {rc=0} 10:21:56.592410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25746): Launched 10:21:56.899648 run osmo-hlr_10.42.42.2(pid=25747): Launched 10:21:57.017095 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:57.562982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25749): Launched 10:21:57.872060 run osmo-stp_10.42.42.5(pid=25750): Launched 10:21:57.989732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:58.519345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25752): Launched 10:21:58.637277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:58.897474 run patchelf(pid=25753): Launched 10:21:59.069705 run osmo-stp_10.42.42.5(pid=25750): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25750)] 10:21:59.200470 run osmo-stp_10.42.42.5(pid=25750): stdout: | (launched: 2022-12-09_10:21:57.813991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:59.333216 run osmo-stp_10.42.42.5(pid=25750): stderr: | 20221209102157985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102157985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102157985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102157986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102157986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102157986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102157986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:59.465084 run osmo-stp_10.42.42.5(pid=25750): stdout: | (launched: 2022-12-09_10:21:57.813991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:59.591489 run osmo-stp_10.42.42.5(pid=25750): stderr: | 20221209102157985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102157985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102157985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102157986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102157986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102157986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102157986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:59.741672 run patchelf(pid=25753): Terminating (SIGINT) 10:21:59.914459 run patchelf(pid=25753): Terminated: ok {rc=0} 10:22:00.039074 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25750): Process ended prematurely: osmo-stp_10.42.42.5(pid=25750) [trial-2358↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25750)] [trial-2358↪gprs:trx-sysmocell5000↪iperf3.py:8] 10:22:00.048837 tst iperf3.py:8: Test FAILED (7.6 sec) 10:22:00.076457 run osmo-hlr_10.42.42.2(pid=25747): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25747)] 10:22:00.124685 run osmo-hlr_10.42.42.2(pid=25747): stdout: | (launched: 2022-12-09_10:21:56.842975) 10:22:00.174736 run osmo-hlr_10.42.42.2(pid=25747): stderr: | 20221209102157019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102157019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102157019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102157019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102157019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102157019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102157031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102157039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102157039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102157040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:00.225354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25742): Terminating (SIGTERM) 10:22:00.265772 run iperf3-srv_10.42.42.10(pid=25743): Terminating (SIGTERM) 10:22:00.305974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25746): Terminating (SIGTERM) 10:22:00.346709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25749): Terminating (SIGTERM) 10:22:00.387016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25752): Terminating (SIGTERM) 10:22:00.427930 --- ParallelTerminationStrategy: PID 25742 died... 10:22:00.447376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25742): Terminated: ok {rc=0} 10:22:00.492203 --- ParallelTerminationStrategy: PID 25743 died... 10:22:00.511081 run iperf3-srv_10.42.42.10(pid=25743): Terminated {rc=256} 10:22:00.555518 --- ParallelTerminationStrategy: PID 25746 died... 10:22:00.574508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25746): Terminated: ok {rc=0} 10:22:00.619105 --- ParallelTerminationStrategy: PID 25749 died... 10:22:00.638119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25749): Terminated: ok {rc=0} 10:22:00.682944 --- ParallelTerminationStrategy: PID 25752 died... 10:22:00.701980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25752): Terminated: ok {rc=0} 10:22:00.787428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 10:22:01.950086 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:01.962867 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:22:02.017036 tst iperf3m4.py: using LAC 20799 10:22:02.140147 tst iperf3m4.py: using RAC 144 10:22:02.282668 tst iperf3m4.py: using CellId 20799 10:22:02.410240 tst iperf3m4.py: using BVCI 20800 10:22:02.529903 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.541340 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.552392 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.563825 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.575083 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.586927 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.598486 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.609767 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:02.621094 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:22:02.743682 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:22:02.861874 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:22:02.983989 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:22:03.105670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:22:03.327209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:03.657923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25754): Launched 10:22:03.947314 run iperf3-srv_10.42.42.10(pid=25755): Launched 10:22:04.072534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:22:04.293182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:04.623283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25756): Launched 10:22:04.912240 run iperf3-srv_10.42.42.10(pid=25757): Launched 10:22:05.037439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:22:05.257314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:05.587174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25758): Launched 10:22:05.875807 run iperf3-srv_10.42.42.10(pid=25759): Launched 10:22:06.002271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:22:06.223164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:06.554299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25760): Launched 10:22:06.842272 run iperf3-srv_10.42.42.10(pid=25761): Launched 10:22:06.966169 tst iperf3m4.py:8: start network... 10:22:07.187125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:07.698598 run create_hlr_db(pid=25762): Launched 10:22:07.826967 bus /gobi_6: Setting Powered False 10:22:08.891449 run create_hlr_db(pid=25762): Terminated: ok {rc=0} 10:22:09.349782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25764): Launched 10:22:09.683074 run osmo-hlr_10.42.42.2(pid=25765): Launched 10:22:09.811573 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:10.379783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25767): Launched 10:22:10.711593 run osmo-stp_10.42.42.5(pid=25768): Launched 10:22:10.838525 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:11.408359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25770): Launched 10:22:11.535749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:11.815407 run patchelf(pid=25771): Launched 10:22:12.000122 run osmo-stp_10.42.42.5(pid=25768): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25768)] 10:22:12.139207 run osmo-stp_10.42.42.5(pid=25768): stdout: | (launched: 2022-12-09_10:22:10.651026) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:12.279846 run osmo-stp_10.42.42.5(pid=25768): stderr: | 20221209102210841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102210841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102210841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102210842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102210842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102210842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102210842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:12.420368 run osmo-stp_10.42.42.5(pid=25768): stdout: | (launched: 2022-12-09_10:22:10.651026) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:12.555581 run osmo-stp_10.42.42.5(pid=25768): stderr: | 20221209102210841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102210841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102210841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102210842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102210842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102210842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102210842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:12.716172 run patchelf(pid=25771): Terminating (SIGINT) 10:22:12.900656 run patchelf(pid=25771): Terminated: ok {rc=0} 10:22:13.033465 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25768): Process ended prematurely: osmo-stp_10.42.42.5(pid=25768) [trial-2358↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25768)] [trial-2358↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 10:22:13.043823 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:22:13.073887 run osmo-hlr_10.42.42.2(pid=25765): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25765)] 10:22:13.125293 run osmo-hlr_10.42.42.2(pid=25765): stdout: | (launched: 2022-12-09_10:22:09.622201) 10:22:13.178461 run osmo-hlr_10.42.42.2(pid=25765): stderr: | 20221209102209818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102209818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102209818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102209818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102209819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102209819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102209831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102209841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102209842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102209842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:13.232184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25754): Terminating (SIGTERM) 10:22:13.275112 run iperf3-srv_10.42.42.10(pid=25755): Terminating (SIGTERM) 10:22:13.317881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25756): Terminating (SIGTERM) 10:22:13.360768 run iperf3-srv_10.42.42.10(pid=25757): Terminating (SIGTERM) 10:22:13.403569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25758): Terminating (SIGTERM) 10:22:13.446386 run iperf3-srv_10.42.42.10(pid=25759): Terminating (SIGTERM) 10:22:13.488931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25760): Terminating (SIGTERM) 10:22:13.531721 run iperf3-srv_10.42.42.10(pid=25761): Terminating (SIGTERM) 10:22:13.574447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25764): Terminating (SIGTERM) 10:22:13.617139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25767): Terminating (SIGTERM) 10:22:13.659968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25770): Terminating (SIGTERM) 10:22:13.703366 --- ParallelTerminationStrategy: PID 25754 died... 10:22:13.724090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25754): Terminated: ok {rc=0} 10:22:13.772276 --- ParallelTerminationStrategy: PID 25755 died... 10:22:13.792296 run iperf3-srv_10.42.42.10(pid=25755): Terminated {rc=256} 10:22:13.839735 --- ParallelTerminationStrategy: PID 25756 died... 10:22:13.859954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25756): Terminated: ok {rc=0} 10:22:13.907255 --- ParallelTerminationStrategy: PID 25757 died... 10:22:13.927156 run iperf3-srv_10.42.42.10(pid=25757): Terminated {rc=256} 10:22:13.974320 --- ParallelTerminationStrategy: PID 25758 died... 10:22:13.994139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25758): Terminated: ok {rc=0} 10:22:14.041480 --- ParallelTerminationStrategy: PID 25759 died... 10:22:14.061337 run iperf3-srv_10.42.42.10(pid=25759): Terminated {rc=256} 10:22:14.108526 --- ParallelTerminationStrategy: PID 25760 died... 10:22:14.128413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25760): Terminated: ok {rc=0} 10:22:14.175454 --- ParallelTerminationStrategy: PID 25761 died... 10:22:14.195262 run iperf3-srv_10.42.42.10(pid=25761): Terminated {rc=256} 10:22:14.242293 --- ParallelTerminationStrategy: PID 25764 died... 10:22:14.262034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25764): Terminated: ok {rc=0} 10:22:14.309153 --- ParallelTerminationStrategy: PID 25767 died... 10:22:14.328917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25767): Terminated: ok {rc=0} 10:22:14.376314 --- ParallelTerminationStrategy: PID 25770 died... 10:22:14.396219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25770): Terminated: ok {rc=0} 10:22:14.486516 bus /gobi_4: Setting Powered False 10:22:15.585178 bus /gobi_4: Setting Powered False 10:22:16.702213 bus /gobi_1: Setting Powered False 10:22:17.814044 bus /gobi_1: Setting Powered False 10:22:18.930018 bus /gobi_0: Setting Powered False 10:22:20.031262 bus /gobi_0: Setting Powered False 10:22:21.149990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 10:22:22.256874 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.268795 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:22:22.320608 tst ping.py: using LAC 20800 10:22:22.448815 tst ping.py: using RAC 145 10:22:22.576413 tst ping.py: using CellId 20800 10:22:22.702717 tst ping.py: using BVCI 20801 10:22:22.822588 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.833891 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.845063 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.856383 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.867647 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.878829 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.890284 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:22.901770 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:22:23.017065 tst ping.py:19: start network... 10:22:23.216389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:23.681652 run create_hlr_db(pid=25772): Launched 10:22:23.806266 bus /gobi_6: Setting Powered False 10:22:24.866326 run create_hlr_db(pid=25772): Terminated: ok {rc=0} 10:22:25.305611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25774): Launched 10:22:25.631535 run osmo-hlr_10.42.42.2(pid=25775): Launched 10:22:25.756076 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:26.318536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25777): Launched 10:22:26.641987 run osmo-stp_10.42.42.5(pid=25778): Launched 10:22:26.766456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:27.322661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25780): Launched 10:22:27.447435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:27.720503 run patchelf(pid=25781): Launched 10:22:27.902304 run osmo-stp_10.42.42.5(pid=25778): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25778)] 10:22:28.038946 run osmo-stp_10.42.42.5(pid=25778): stdout: | (launched: 2022-12-09_10:22:26.582589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:28.177306 run osmo-stp_10.42.42.5(pid=25778): stderr: | 20221209102226775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102226775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102226775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102226776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102226776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102226776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102226776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:28.315783 run osmo-stp_10.42.42.5(pid=25778): stdout: | (launched: 2022-12-09_10:22:26.582589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:28.448200 run osmo-stp_10.42.42.5(pid=25778): stderr: | 20221209102226775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102226775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102226775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102226776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102226776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102226776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102226776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:28.605436 run patchelf(pid=25781): Terminating (SIGINT) 10:22:28.785957 run patchelf(pid=25781): Terminated: ok {rc=0} 10:22:28.915692 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25778): Process ended prematurely: osmo-stp_10.42.42.5(pid=25778) [trial-2358↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25778)] [trial-2358↪gprs:trx-sysmocell5000↪ping.py:22] 10:22:28.925444 tst ping.py:22: Test FAILED (6.7 sec) 10:22:28.954653 run osmo-hlr_10.42.42.2(pid=25775): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25775)] 10:22:29.005739 run osmo-hlr_10.42.42.2(pid=25775): stdout: | (launched: 2022-12-09_10:22:25.571778) 10:22:29.058736 run osmo-hlr_10.42.42.2(pid=25775): stderr: | 20221209102225770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102225770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102225770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102225770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102225770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102225770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102225783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102225791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102225792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102225792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:29.112438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25774): Terminating (SIGTERM) 10:22:29.155268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25777): Terminating (SIGTERM) 10:22:29.198353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25780): Terminating (SIGTERM) 10:22:29.241438 --- ParallelTerminationStrategy: PID 25774 died... 10:22:29.261852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25774): Terminated: ok {rc=0} 10:22:29.309663 --- ParallelTerminationStrategy: PID 25777 died... 10:22:29.329526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25777): Terminated: ok {rc=0} 10:22:29.377570 --- ParallelTerminationStrategy: PID 25780 died... 10:22:29.397470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25780): Terminated: ok {rc=0} 10:22:29.487702 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 10:22:30.575484 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:30.587475 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:22:30.640323 tst ping_idle_ping.py: using LAC 20801 10:22:30.769320 tst ping_idle_ping.py: using RAC 146 10:22:30.935324 tst ping_idle_ping.py: using CellId 20801 10:22:31.064768 tst ping_idle_ping.py: using BVCI 20802 10:22:31.186458 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.199224 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.214032 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.226605 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.239800 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.254505 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.268338 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:22:31.280647 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:22:31.414518 tst ping_idle_ping.py:24: start network... 10:22:31.625084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:32.108505 run create_hlr_db(pid=25782): Launched 10:22:32.250824 bus /gobi_6: Setting Powered False 10:22:33.315094 run create_hlr_db(pid=25782): Terminated: ok {rc=0} 10:22:33.750847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25784): Launched 10:22:34.054484 run osmo-hlr_10.42.42.2(pid=25785): Launched 10:22:34.169869 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:34.701037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25787): Launched 10:22:35.003164 run osmo-stp_10.42.42.5(pid=25788): Launched 10:22:35.117577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:35.641071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25790): Launched 10:22:35.755825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:36.012288 run patchelf(pid=25795): Launched 10:22:36.194768 run osmo-stp_10.42.42.5(pid=25788): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25788)] 10:22:36.332080 run osmo-stp_10.42.42.5(pid=25788): stdout: | (launched: 2022-12-09_10:22:34.946966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:36.471309 run osmo-stp_10.42.42.5(pid=25788): stderr: | 20221209102235116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102235116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102235117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102235117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102235118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102235118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102235118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:36.610673 run osmo-stp_10.42.42.5(pid=25788): stdout: | (launched: 2022-12-09_10:22:34.946966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:36.744068 run osmo-stp_10.42.42.5(pid=25788): stderr: | 20221209102235116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102235116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102235117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102235117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102235118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102235118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102235118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:36.902126 run patchelf(pid=25795): Terminating (SIGINT) 10:22:37.083605 run patchelf(pid=25795): Terminated: ok {rc=0} 10:22:37.214643 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25788): Process ended prematurely: osmo-stp_10.42.42.5(pid=25788) [trial-2358↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25788)] [trial-2358↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 10:22:37.224462 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:22:37.253929 run osmo-hlr_10.42.42.2(pid=25785): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25785)] 10:22:37.305445 run osmo-hlr_10.42.42.2(pid=25785): stdout: | (launched: 2022-12-09_10:22:33.998060) 10:22:37.359057 run osmo-hlr_10.42.42.2(pid=25785): stderr: | 20221209102234175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102234175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102234176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102234176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102234176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102234176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102234187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102234197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102234197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102234197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:37.413387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25784): Terminating (SIGTERM) 10:22:37.456828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25787): Terminating (SIGTERM) 10:22:37.500036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25790): Terminating (SIGTERM) 10:22:37.543591 --- ParallelTerminationStrategy: PID 25784 died... 10:22:37.564303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25784): Terminated: ok {rc=0} 10:22:37.612507 --- ParallelTerminationStrategy: PID 25787 died... 10:22:37.632635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25787): Terminated: ok {rc=0} 10:22:37.680451 --- ParallelTerminationStrategy: PID 25790 died... 10:22:37.700558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25790): Terminated: ok {rc=0} 10:22:37.790558 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 10:22:39.108749 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:22:39.114742 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:22:39.150447 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:22:39.189745 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:22:39.277994 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:22:39.312375 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:22:39.351623 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:22:39.946976 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:22:40.000401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.011979 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:22:40.063910 tst cs_paging_gprs_active.py: using LAC 20802 10:22:40.194313 tst cs_paging_gprs_active.py: using RAC 147 10:22:40.324035 tst cs_paging_gprs_active.py: using CellId 20802 10:22:40.452017 tst cs_paging_gprs_active.py: using BVCI 20803 10:22:40.571573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.583046 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.594267 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.605666 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.617122 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.628611 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.640192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.651692 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:40.663354 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:22:40.781678 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:22:40.902256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:22:41.123726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:41.453383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25799): Launched 10:22:41.741807 run iperf3-srv_10.42.42.10(pid=25800): Launched 10:22:41.867480 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:22:42.090691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:42.422757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25801): Launched 10:22:42.708550 run iperf3-srv_10.42.42.10(pid=25802): Launched 10:22:42.835050 tst cs_paging_gprs_active.py:38: start network... 10:22:43.055835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:43.566264 run create_hlr_db(pid=25803): Launched 10:22:43.694057 bus /gobi_6: Setting Powered False 10:22:44.759342 run create_hlr_db(pid=25803): Terminated: ok {rc=0} 10:22:45.216155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25805): Launched 10:22:45.548788 run osmo-hlr_10.42.42.2(pid=25806): Launched 10:22:45.675147 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:46.274173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25808): Launched 10:22:46.605749 run osmo-stp_10.42.42.5(pid=25809): Launched 10:22:46.868887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:47.488453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25811): Launched 10:22:47.615152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:47.894278 run patchelf(pid=25812): Launched 10:22:48.078957 run osmo-stp_10.42.42.5(pid=25809): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25809)] 10:22:48.217964 run osmo-stp_10.42.42.5(pid=25809): stdout: | (launched: 2022-12-09_10:22:46.547368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:48.357826 run osmo-stp_10.42.42.5(pid=25809): stderr: | 20221209102246827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102246827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102246827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102246827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102246828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102246828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102246828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:48.497793 run osmo-stp_10.42.42.5(pid=25809): stdout: | (launched: 2022-12-09_10:22:46.547368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:48.632207 run osmo-stp_10.42.42.5(pid=25809): stderr: | 20221209102246827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102246827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102246827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102246827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102246828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102246828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102246828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:48.792533 run patchelf(pid=25812): Terminating (SIGINT) 10:22:48.975561 run patchelf(pid=25812): Terminated: ok {rc=0} 10:22:49.108071 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25809): Process ended prematurely: osmo-stp_10.42.42.5(pid=25809) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25809)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:22:49.118467 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 10:22:49.148018 run osmo-hlr_10.42.42.2(pid=25806): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25806)] 10:22:49.199068 run osmo-hlr_10.42.42.2(pid=25806): stdout: | (launched: 2022-12-09_10:22:45.486959) 10:22:49.251836 run osmo-hlr_10.42.42.2(pid=25806): stderr: | 20221209102245687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102245687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102245687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102245687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102245687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102245687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102245700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102245708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102245708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102245708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:49.305127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25799): Terminating (SIGTERM) 10:22:49.347661 run iperf3-srv_10.42.42.10(pid=25800): Terminating (SIGTERM) 10:22:49.390284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25801): Terminating (SIGTERM) 10:22:49.433135 run iperf3-srv_10.42.42.10(pid=25802): Terminating (SIGTERM) 10:22:49.475607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25805): Terminating (SIGTERM) 10:22:49.518216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25808): Terminating (SIGTERM) 10:22:49.560790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25811): Terminating (SIGTERM) 10:22:49.603790 --- ParallelTerminationStrategy: PID 25799 died... 10:22:49.623971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25799): Terminated: ok {rc=0} 10:22:49.671307 --- ParallelTerminationStrategy: PID 25800 died... 10:22:49.691138 run iperf3-srv_10.42.42.10(pid=25800): Terminated {rc=256} 10:22:49.738406 --- ParallelTerminationStrategy: PID 25801 died... 10:22:49.758159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25801): Terminated: ok {rc=0} 10:22:49.805212 --- ParallelTerminationStrategy: PID 25802 died... 10:22:49.824848 run iperf3-srv_10.42.42.10(pid=25802): Terminated {rc=256} 10:22:49.872373 --- ParallelTerminationStrategy: PID 25805 died... 10:22:49.892033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25805): Terminated: ok {rc=0} 10:22:49.938881 --- ParallelTerminationStrategy: PID 25808 died... 10:22:49.958597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25808): Terminated: ok {rc=0} 10:22:50.005554 --- ParallelTerminationStrategy: PID 25811 died... 10:22:50.025304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25811): Terminated: ok {rc=0} 10:22:50.114875 bus /gobi_0: Setting Powered False 10:22:51.215730 bus /gobi_0: Setting Powered False 10:22:52.333756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:22:53.485580 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:53.497594 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:22:53.553450 tst iperf3.py: using LAC 20803 10:22:53.681132 tst iperf3.py: using RAC 148 10:22:53.810679 tst iperf3.py: using CellId 20803 10:22:53.939377 tst iperf3.py: using BVCI 20804 10:22:54.058193 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.069726 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.080764 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.092148 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.103578 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.115143 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.126759 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.138099 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:22:54.149775 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:22:54.267567 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:22:54.471645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:54.777529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25813): Launched 10:22:55.045538 run iperf3-srv_10.42.42.10(pid=25814): Launched 10:22:55.161064 tst iperf3.py:8: start network... 10:22:55.366107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:55.844839 run create_hlr_db(pid=25815): Launched 10:22:55.970882 bus /gobi_6: Setting Powered False 10:22:57.031498 run create_hlr_db(pid=25815): Terminated: ok {rc=0} 10:22:57.480655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25817): Launched 10:22:57.814932 run osmo-hlr_10.42.42.2(pid=25818): Launched 10:22:57.942992 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:58.515120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25820): Launched 10:22:58.844252 run osmo-stp_10.42.42.5(pid=25821): Launched 10:22:58.971248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:59.538648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25823): Launched 10:22:59.666522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:59.945738 run patchelf(pid=25824): Launched 10:23:00.129388 run osmo-stp_10.42.42.5(pid=25821): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25821)] 10:23:00.268893 run osmo-stp_10.42.42.5(pid=25821): stdout: | (launched: 2022-12-09_10:22:58.783526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:00.409982 run osmo-stp_10.42.42.5(pid=25821): stderr: | 20221209102258977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102258977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102258978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102258978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102258978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102258978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102258979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:00.551050 run osmo-stp_10.42.42.5(pid=25821): stdout: | (launched: 2022-12-09_10:22:58.783526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:00.686732 run osmo-stp_10.42.42.5(pid=25821): stderr: | 20221209102258977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102258977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102258978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102258978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102258978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102258978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102258979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:00.862161 run patchelf(pid=25824): Terminating (SIGINT) 10:23:01.055426 run patchelf(pid=25824): Terminated: ok {rc=0} 10:23:01.189805 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25821): Process ended prematurely: osmo-stp_10.42.42.5(pid=25821) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25821)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 10:23:01.200918 tst iperf3.py:8: Test FAILED (7.8 sec) 10:23:01.231351 run osmo-hlr_10.42.42.2(pid=25818): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25818)] 10:23:01.283525 run osmo-hlr_10.42.42.2(pid=25818): stdout: | (launched: 2022-12-09_10:22:57.754439) 10:23:01.337654 run osmo-hlr_10.42.42.2(pid=25818): stderr: | 20221209102257952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102257953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102257953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102257953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102257953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102257953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102257968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102257978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102257978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102257979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:01.392170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25813): Terminating (SIGTERM) 10:23:01.436464 run iperf3-srv_10.42.42.10(pid=25814): Terminating (SIGTERM) 10:23:01.483151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25817): Terminating (SIGTERM) 10:23:01.527373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25820): Terminating (SIGTERM) 10:23:01.572314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25823): Terminating (SIGTERM) 10:23:01.621550 --- ParallelTerminationStrategy: PID 25813 died... 10:23:01.647751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25813): Terminated: ok {rc=0} 10:23:01.704364 --- ParallelTerminationStrategy: PID 25814 died... 10:23:01.729734 run iperf3-srv_10.42.42.10(pid=25814): Terminated {rc=256} 10:23:01.793807 --- ParallelTerminationStrategy: PID 25817 died... 10:23:01.823577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25817): Terminated: ok {rc=0} 10:23:01.891011 --- ParallelTerminationStrategy: PID 25820 died... 10:23:01.912198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25820): Terminated: ok {rc=0} 10:23:01.970524 --- ParallelTerminationStrategy: PID 25823 died... 10:23:01.994608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25823): Terminated: ok {rc=0} 10:23:02.101534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:23:03.298732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:03.311817 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:23:03.379715 tst iperf3m4.py: using LAC 20804 10:23:03.539419 tst iperf3m4.py: using RAC 149 10:23:03.696936 tst iperf3m4.py: using CellId 20804 10:23:03.850810 tst iperf3m4.py: using BVCI 20805 10:23:03.982883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:03.995308 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.008733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.022231 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.035355 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.047505 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.060454 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.074302 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:04.087551 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:23:04.212077 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:23:04.338598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:23:04.463789 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:23:04.591049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:23:04.818710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:05.153450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26094): Launched 10:23:05.454661 run iperf3-srv_10.42.42.10(pid=26095): Launched 10:23:05.594016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:23:05.818821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:06.152291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Launched 10:23:06.438204 run iperf3-srv_10.42.42.10(pid=26099): Launched 10:23:06.575624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:23:06.789348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:07.105489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Launched 10:23:07.395025 run iperf3-srv_10.42.42.10(pid=26101): Launched 10:23:07.527151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:23:07.738845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:08.056043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26102): Launched 10:23:08.342227 run iperf3-srv_10.42.42.10(pid=26103): Launched 10:23:08.474419 tst iperf3m4.py:8: start network... 10:23:08.687347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:09.182080 run create_hlr_db(pid=26104): Launched 10:23:09.332521 bus /gobi_6: Setting Powered False 10:23:10.395548 run create_hlr_db(pid=26104): Terminated: ok {rc=0} 10:23:10.843627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26106): Launched 10:23:11.173928 run osmo-hlr_10.42.42.2(pid=26107): Launched 10:23:11.412707 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:12.139884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26109): Launched 10:23:12.469016 run osmo-stp_10.42.42.5(pid=26110): Launched 10:23:12.718335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:13.370693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26112): Launched 10:23:13.509836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:13.794771 run patchelf(pid=26113): Launched 10:23:13.994274 run osmo-stp_10.42.42.5(pid=26110): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26110)] 10:23:14.136718 run osmo-stp_10.42.42.5(pid=26110): stdout: | (launched: 2022-12-09_10:23:12.410569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:14.281167 run osmo-stp_10.42.42.5(pid=26110): stderr: | 20221209102312702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102312702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102312703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102312703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102312704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102312704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102312704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:14.426020 run osmo-stp_10.42.42.5(pid=26110): stdout: | (launched: 2022-12-09_10:23:12.410569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:14.564519 run osmo-stp_10.42.42.5(pid=26110): stderr: | 20221209102312702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102312702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102312703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102312703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102312704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102312704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102312704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:14.728651 run patchelf(pid=26113): Terminating (SIGINT) 10:23:14.917988 run patchelf(pid=26113): Terminated: ok {rc=0} 10:23:15.054543 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26110): Process ended prematurely: osmo-stp_10.42.42.5(pid=26110) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26110)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 10:23:15.066144 tst iperf3m4.py:8: Test FAILED (11.8 sec) 10:23:15.099591 run osmo-hlr_10.42.42.2(pid=26107): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26107)] 10:23:15.153391 run osmo-hlr_10.42.42.2(pid=26107): stdout: | (launched: 2022-12-09_10:23:11.113938) 10:23:15.209110 run osmo-hlr_10.42.42.2(pid=26107): stderr: | 20221209102311450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102311450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102311450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102311450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102311450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102311450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102311467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102311484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102311484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102311484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:15.265355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26094): Terminating (SIGTERM) 10:23:15.311020 run iperf3-srv_10.42.42.10(pid=26095): Terminating (SIGTERM) 10:23:15.359040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Terminating (SIGTERM) 10:23:15.405171 run iperf3-srv_10.42.42.10(pid=26099): Terminating (SIGTERM) 10:23:15.453477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Terminating (SIGTERM) 10:23:15.499298 run iperf3-srv_10.42.42.10(pid=26101): Terminating (SIGTERM) 10:23:15.547127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26102): Terminating (SIGTERM) 10:23:15.593196 run iperf3-srv_10.42.42.10(pid=26103): Terminating (SIGTERM) 10:23:15.641112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26106): Terminating (SIGTERM) 10:23:15.686910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26109): Terminating (SIGTERM) 10:23:15.734070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26112): Terminating (SIGTERM) 10:23:15.781735 --- ParallelTerminationStrategy: PID 26094 died... 10:23:15.803126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26094): Terminated: ok {rc=0} 10:23:15.860106 --- ParallelTerminationStrategy: PID 26095 died... 10:23:15.881262 run iperf3-srv_10.42.42.10(pid=26095): Terminated {rc=256} 10:23:15.932458 --- ParallelTerminationStrategy: PID 26098 died... 10:23:15.953876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Terminated: ok {rc=0} 10:23:16.004547 --- ParallelTerminationStrategy: PID 26099 died... 10:23:16.025685 run iperf3-srv_10.42.42.10(pid=26099): Terminated {rc=256} 10:23:16.076206 --- ParallelTerminationStrategy: PID 26100 died... 10:23:16.097037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Terminated: ok {rc=0} 10:23:16.147459 --- ParallelTerminationStrategy: PID 26101 died... 10:23:16.168248 run iperf3-srv_10.42.42.10(pid=26101): Terminated {rc=256} 10:23:16.218374 --- ParallelTerminationStrategy: PID 26102 died... 10:23:16.239230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26102): Terminated: ok {rc=0} 10:23:16.289411 --- ParallelTerminationStrategy: PID 26103 died... 10:23:16.310243 run iperf3-srv_10.42.42.10(pid=26103): Terminated {rc=256} 10:23:16.360495 --- ParallelTerminationStrategy: PID 26106 died... 10:23:16.381455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26106): Terminated: ok {rc=0} 10:23:16.431810 --- ParallelTerminationStrategy: PID 26109 died... 10:23:16.452909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26109): Terminated: ok {rc=0} 10:23:16.503659 --- ParallelTerminationStrategy: PID 26112 died... 10:23:16.525009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26112): Terminated: ok {rc=0} 10:23:16.630784 bus /gobi_4: Setting Powered False 10:23:17.768307 bus /gobi_4: Setting Powered False 10:23:18.886132 bus /gobi_1: Setting Powered False 10:23:19.988800 bus /gobi_1: Setting Powered False 10:23:21.108876 bus /gobi_0: Setting Powered False 10:23:22.215366 bus /gobi_0: Setting Powered False 10:23:23.337972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 10:23:24.442483 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:24.454069 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:23:24.505722 tst ping.py: using LAC 20805 10:23:24.635063 tst ping.py: using RAC 150 10:23:24.762713 tst ping.py: using CellId 20805 10:23:24.881430 tst ping.py: using BVCI 20806 10:23:24.990787 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.001859 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.012655 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.023563 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.034244 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.045342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.056212 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:25.067058 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:23:25.183850 tst ping.py:19: start network... 10:23:25.382255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:25.849505 run create_hlr_db(pid=26116): Launched 10:23:25.974655 bus /gobi_6: Setting Powered False 10:23:27.034878 run create_hlr_db(pid=26116): Terminated: ok {rc=0} 10:23:27.476297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26118): Launched 10:23:27.803853 run osmo-hlr_10.42.42.2(pid=26119): Launched 10:23:27.929684 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:28.489463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26121): Launched 10:23:28.816109 run osmo-stp_10.42.42.5(pid=26122): Launched 10:23:28.941761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:29.502417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26124): Launched 10:23:29.626926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:29.902232 run patchelf(pid=26125): Launched 10:23:30.083472 run osmo-stp_10.42.42.5(pid=26122): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26122)] 10:23:30.220929 run osmo-stp_10.42.42.5(pid=26122): stdout: | (launched: 2022-12-09_10:23:28.755506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:30.359382 run osmo-stp_10.42.42.5(pid=26122): stderr: | 20221209102328947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102328947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102328947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102328948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102328948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102328948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102328948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:30.498304 run osmo-stp_10.42.42.5(pid=26122): stdout: | (launched: 2022-12-09_10:23:28.755506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:30.631328 run osmo-stp_10.42.42.5(pid=26122): stderr: | 20221209102328947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102328947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102328947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102328948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102328948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102328948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102328948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:30.789219 run patchelf(pid=26125): Terminating (SIGINT) 10:23:30.988251 run patchelf(pid=26125): Terminated: ok {rc=0} 10:23:31.124039 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26122): Process ended prematurely: osmo-stp_10.42.42.5(pid=26122) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26122)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 10:23:31.134830 tst ping.py:22: Test FAILED (6.7 sec) 10:23:31.167045 run osmo-hlr_10.42.42.2(pid=26119): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26119)] 10:23:31.220247 run osmo-hlr_10.42.42.2(pid=26119): stdout: | (launched: 2022-12-09_10:23:27.743394) 10:23:31.275184 run osmo-hlr_10.42.42.2(pid=26119): stderr: | 20221209102327941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102327941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102327941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102327941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102327942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102327942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102327954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102327963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102327963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102327963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:31.330934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26118): Terminating (SIGTERM) 10:23:31.376112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26121): Terminating (SIGTERM) 10:23:31.421502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26124): Terminating (SIGTERM) 10:23:31.468265 --- ParallelTerminationStrategy: PID 26118 died... 10:23:31.489600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26118): Terminated: ok {rc=0} 10:23:31.541241 --- ParallelTerminationStrategy: PID 26121 died... 10:23:31.562161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26121): Terminated: ok {rc=0} 10:23:31.612593 --- ParallelTerminationStrategy: PID 26124 died... 10:23:31.633512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26124): Terminated: ok {rc=0} 10:23:31.726798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:23:32.817590 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:32.830072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:23:32.885418 tst ping_idle_ping.py: using LAC 20806 10:23:33.014663 tst ping_idle_ping.py: using RAC 151 10:23:33.142467 tst ping_idle_ping.py: using CellId 20806 10:23:33.272156 tst ping_idle_ping.py: using BVCI 20807 10:23:33.392382 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.404229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.415826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.427791 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.440155 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.451932 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.464018 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:23:33.476405 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:23:33.593943 tst ping_idle_ping.py:24: start network... 10:23:33.807916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:34.313278 run create_hlr_db(pid=26126): Launched 10:23:34.439090 bus /gobi_6: Setting Powered False 10:23:35.503323 run create_hlr_db(pid=26126): Terminated: ok {rc=0} 10:23:35.957608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26128): Launched 10:23:36.285897 run osmo-hlr_10.42.42.2(pid=26129): Launched 10:23:36.412172 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:36.974344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26131): Launched 10:23:37.299211 run osmo-stp_10.42.42.5(pid=26132): Launched 10:23:37.425698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:37.989122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26134): Launched 10:23:38.115636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:38.390676 run patchelf(pid=26135): Launched 10:23:38.571821 run osmo-stp_10.42.42.5(pid=26132): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26132)] 10:23:38.709853 run osmo-stp_10.42.42.5(pid=26132): stdout: | (launched: 2022-12-09_10:23:37.239021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:38.849202 run osmo-stp_10.42.42.5(pid=26132): stderr: | 20221209102337431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102337431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102337431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102337432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102337432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102337432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102337432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:38.987954 run osmo-stp_10.42.42.5(pid=26132): stdout: | (launched: 2022-12-09_10:23:37.239021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:39.121371 run osmo-stp_10.42.42.5(pid=26132): stderr: | 20221209102337431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102337431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102337431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102337432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102337432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102337432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102337432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:39.279084 run patchelf(pid=26135): Terminating (SIGINT) 10:23:39.460415 run patchelf(pid=26135): Terminated: ok {rc=0} 10:23:39.591221 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26132): Process ended prematurely: osmo-stp_10.42.42.5(pid=26132) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26132)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 10:23:39.600878 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:23:39.629859 run osmo-hlr_10.42.42.2(pid=26129): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26129)] 10:23:39.680928 run osmo-hlr_10.42.42.2(pid=26129): stdout: | (launched: 2022-12-09_10:23:36.225461) 10:23:39.733551 run osmo-hlr_10.42.42.2(pid=26129): stderr: | 20221209102336424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102336424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102336424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102336424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102336424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102336424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102336437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102336445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102336446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102336446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:39.786930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26128): Terminating (SIGTERM) 10:23:39.829052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26131): Terminating (SIGTERM) 10:23:39.872079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26134): Terminating (SIGTERM) 10:23:39.914917 --- ParallelTerminationStrategy: PID 26128 died... 10:23:39.935217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26128): Terminated: ok {rc=0} 10:23:39.982146 --- ParallelTerminationStrategy: PID 26131 died... 10:23:40.002437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26131): Terminated: ok {rc=0} 10:23:40.050032 --- ParallelTerminationStrategy: PID 26134 died... 10:23:40.070122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26134): Terminated: ok {rc=0} 10:23:40.159596 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:23:41.474985 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:41.481579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:23:41.516521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:23:41.554842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:23:41.641497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:23:41.675007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:23:41.713226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:23:42.311197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:23:42.363209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.374209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:23:42.443641 tst cs_paging_gprs_active.py: using LAC 20807 10:23:42.563415 tst cs_paging_gprs_active.py: using RAC 152 10:23:42.681999 tst cs_paging_gprs_active.py: using CellId 20807 10:23:42.803718 tst cs_paging_gprs_active.py: using BVCI 20808 10:23:42.915713 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.926686 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.937413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.948114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.958879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.969556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.980282 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:42.990938 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:43.002055 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:23:43.119476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:23:43.237072 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:23:43.441451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:43.749210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26139): Launched 10:23:44.016886 run iperf3-srv_10.42.42.10(pid=26140): Launched 10:23:44.133307 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:23:44.337500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:44.645392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26141): Launched 10:23:44.913215 run iperf3-srv_10.42.42.10(pid=26142): Launched 10:23:45.028497 tst cs_paging_gprs_active.py:38: start network... 10:23:45.232676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:45.710827 run create_hlr_db(pid=26143): Launched 10:23:45.842940 bus /gobi_6: Setting Powered False 10:23:46.922950 run create_hlr_db(pid=26143): Terminated: ok {rc=0} 10:23:47.427671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Launched 10:23:47.736427 run osmo-hlr_10.42.42.2(pid=26146): Launched 10:23:47.854785 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:48.383544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Launched 10:23:48.692352 run osmo-stp_10.42.42.5(pid=26149): Launched 10:23:48.809264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:49.340572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Launched 10:23:49.459673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:49.720011 run patchelf(pid=26152): Launched 10:23:49.890732 run osmo-stp_10.42.42.5(pid=26149): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] 10:23:50.020063 run osmo-stp_10.42.42.5(pid=26149): stdout: | (launched: 2022-12-09_10:23:48.635174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:50.151491 run osmo-stp_10.42.42.5(pid=26149): stderr: | 20221209102348810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102348810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102348810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102348810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102348811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102348811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102348811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:50.282563 run osmo-stp_10.42.42.5(pid=26149): stdout: | (launched: 2022-12-09_10:23:48.635174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:50.407696 run osmo-stp_10.42.42.5(pid=26149): stderr: | 20221209102348810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102348810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102348810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102348810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102348811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102348811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102348811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:50.556087 run patchelf(pid=26152): Terminating (SIGINT) 10:23:50.727467 run patchelf(pid=26152): Terminated: ok {rc=0} 10:23:50.851068 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26149): Process ended prematurely: osmo-stp_10.42.42.5(pid=26149) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:23:50.860605 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:23:50.888128 run osmo-hlr_10.42.42.2(pid=26146): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26146)] 10:23:50.936143 run osmo-hlr_10.42.42.2(pid=26146): stdout: | (launched: 2022-12-09_10:23:47.679139) 10:23:50.985728 run osmo-hlr_10.42.42.2(pid=26146): stderr: | 20221209102347857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102347857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102347857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102347857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102347857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102347857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102347870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102347878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102347878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102347878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:51.035681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26139): Terminating (SIGTERM) 10:23:51.075927 run iperf3-srv_10.42.42.10(pid=26140): Terminating (SIGTERM) 10:23:51.115924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26141): Terminating (SIGTERM) 10:23:51.155962 run iperf3-srv_10.42.42.10(pid=26142): Terminating (SIGTERM) 10:23:51.195784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminating (SIGTERM) 10:23:51.235699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Terminating (SIGTERM) 10:23:51.275849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Terminating (SIGTERM) 10:23:51.316002 --- ParallelTerminationStrategy: PID 26139 died... 10:23:51.335217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26139): Terminated: ok {rc=0} 10:23:51.379217 --- ParallelTerminationStrategy: PID 26140 died... 10:23:51.397835 run iperf3-srv_10.42.42.10(pid=26140): Terminated {rc=256} 10:23:51.441618 --- ParallelTerminationStrategy: PID 26141 died... 10:23:51.460154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26141): Terminated: ok {rc=0} 10:23:51.503673 --- ParallelTerminationStrategy: PID 26142 died... 10:23:51.522238 run iperf3-srv_10.42.42.10(pid=26142): Terminated {rc=256} 10:23:51.566064 --- ParallelTerminationStrategy: PID 26145 died... 10:23:51.584526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminated: ok {rc=0} 10:23:51.628460 --- ParallelTerminationStrategy: PID 26148 died... 10:23:51.647152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Terminated: ok {rc=0} 10:23:51.690885 --- ParallelTerminationStrategy: PID 26151 died... 10:23:51.709492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Terminated: ok {rc=0} 10:23:51.793496 bus /gobi_0: Setting Powered False 10:23:52.893146 bus /gobi_0: Setting Powered False 10:23:54.010842 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:23:55.158407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.170087 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:23:55.243595 tst iperf3.py: using LAC 20808 10:23:55.363273 tst iperf3.py: using RAC 153 10:23:55.484606 tst iperf3.py: using CellId 20808 10:23:55.605924 tst iperf3.py: using BVCI 20809 10:23:55.717068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.728007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.738799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.750136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.761915 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.773196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.784448 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.795705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:23:55.807027 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:23:55.928559 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:23:56.150581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:56.480031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Launched 10:23:56.768737 run iperf3-srv_10.42.42.10(pid=26154): Launched 10:23:56.894055 tst iperf3.py:8: start network... 10:23:57.114898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:57.626511 run create_hlr_db(pid=26155): Launched 10:23:57.753227 bus /gobi_6: Setting Powered False 10:23:58.818247 run create_hlr_db(pid=26155): Terminated: ok {rc=0} 10:23:59.256852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26157): Launched 10:23:59.564426 run osmo-hlr_10.42.42.2(pid=26158): Launched 10:23:59.683823 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:00.218692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26160): Launched 10:24:00.525693 run osmo-stp_10.42.42.5(pid=26161): Launched 10:24:00.644907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:01.236727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26163): Launched 10:24:01.411562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:01.684927 run patchelf(pid=26164): Launched 10:24:01.876112 run osmo-stp_10.42.42.5(pid=26161): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26161)] 10:24:02.008181 run osmo-stp_10.42.42.5(pid=26161): stdout: | (launched: 2022-12-09_10:24:00.468462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:02.141742 run osmo-stp_10.42.42.5(pid=26161): stderr: | 20221209102400639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102400639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102400640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102400640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102400640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102400641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102400641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:02.275065 run osmo-stp_10.42.42.5(pid=26161): stdout: | (launched: 2022-12-09_10:24:00.468462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:02.401171 run osmo-stp_10.42.42.5(pid=26161): stderr: | 20221209102400639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102400639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102400640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102400640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102400640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102400641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102400641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:02.550296 run patchelf(pid=26164): Terminating (SIGINT) 10:24:02.722813 run patchelf(pid=26164): Terminated: ok {rc=0} 10:24:02.847256 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26161): Process ended prematurely: osmo-stp_10.42.42.5(pid=26161) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26161)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 10:24:02.857056 tst iperf3.py:8: Test FAILED (7.7 sec) 10:24:02.884813 run osmo-hlr_10.42.42.2(pid=26158): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26158)] 10:24:02.933065 run osmo-hlr_10.42.42.2(pid=26158): stdout: | (launched: 2022-12-09_10:23:59.507347) 10:24:02.983071 run osmo-hlr_10.42.42.2(pid=26158): stderr: | 20221209102359685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102359685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102359685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102359685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102359685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102359685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102359697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102359705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102359705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102359705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:03.033602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Terminating (SIGTERM) 10:24:03.074031 run iperf3-srv_10.42.42.10(pid=26154): Terminating (SIGTERM) 10:24:03.114186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26157): Terminating (SIGTERM) 10:24:03.154431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26160): Terminating (SIGTERM) 10:24:03.194594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26163): Terminating (SIGTERM) 10:24:03.234991 --- ParallelTerminationStrategy: PID 26153 died... 10:24:03.254194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Terminated: ok {rc=0} 10:24:03.299046 --- ParallelTerminationStrategy: PID 26154 died... 10:24:03.317728 run iperf3-srv_10.42.42.10(pid=26154): Terminated {rc=256} 10:24:03.361761 --- ParallelTerminationStrategy: PID 26157 died... 10:24:03.380696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26157): Terminated: ok {rc=0} 10:24:03.424796 --- ParallelTerminationStrategy: PID 26160 died... 10:24:03.444060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26160): Terminated: ok {rc=0} 10:24:03.488138 --- ParallelTerminationStrategy: PID 26163 died... 10:24:03.506771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26163): Terminated: ok {rc=0} 10:24:03.593654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:24:04.745101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:04.756786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:24:04.827500 tst iperf3m4.py: using LAC 20809 10:24:04.947168 tst iperf3m4.py: using RAC 154 10:24:05.068223 tst iperf3m4.py: using CellId 20809 10:24:05.189854 tst iperf3m4.py: using BVCI 20810 10:24:05.302374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.313548 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.324392 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.335245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.346013 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.356845 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.367827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.378563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:05.389523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:24:05.507848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:24:05.625831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:24:05.741700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:24:05.858551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:24:06.063462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:06.373745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Launched 10:24:06.644614 run iperf3-srv_10.42.42.10(pid=26166): Launched 10:24:06.760487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:24:06.965765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:07.275136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Launched 10:24:07.544700 run iperf3-srv_10.42.42.10(pid=26168): Launched 10:24:07.659721 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:24:07.863636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:08.171332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Launched 10:24:08.445813 run iperf3-srv_10.42.42.10(pid=26170): Launched 10:24:08.571443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:24:08.794113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:09.127152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26171): Launched 10:24:09.417128 run iperf3-srv_10.42.42.10(pid=26172): Launched 10:24:09.542926 tst iperf3m4.py:8: start network... 10:24:09.763365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:10.275147 run create_hlr_db(pid=26173): Launched 10:24:10.403185 bus /gobi_6: Setting Powered False 10:24:11.467565 run create_hlr_db(pid=26173): Terminated: ok {rc=0} 10:24:11.925785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26175): Launched 10:24:12.256507 run osmo-hlr_10.42.42.2(pid=26176): Launched 10:24:12.384935 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:12.953632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26178): Launched 10:24:13.285053 run osmo-stp_10.42.42.5(pid=26179): Launched 10:24:13.412641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:13.982124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26181): Launched 10:24:14.108135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:14.387886 run patchelf(pid=26182): Launched 10:24:14.573535 run osmo-stp_10.42.42.5(pid=26179): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26179)] 10:24:14.712933 run osmo-stp_10.42.42.5(pid=26179): stdout: | (launched: 2022-12-09_10:24:13.223644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:14.854728 run osmo-stp_10.42.42.5(pid=26179): stderr: | 20221209102413419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102413419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102413419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102413420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102413420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102413420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102413420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:14.996094 run osmo-stp_10.42.42.5(pid=26179): stdout: | (launched: 2022-12-09_10:24:13.223644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:15.132051 run osmo-stp_10.42.42.5(pid=26179): stderr: | 20221209102413419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102413419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102413419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102413420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102413420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102413420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102413420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:15.292605 run patchelf(pid=26182): Terminating (SIGINT) 10:24:15.476852 run patchelf(pid=26182): Terminated: ok {rc=0} 10:24:15.609972 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26179): Process ended prematurely: osmo-stp_10.42.42.5(pid=26179) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26179)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:24:15.620393 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:24:15.650979 run osmo-hlr_10.42.42.2(pid=26176): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26176)] 10:24:15.702813 run osmo-hlr_10.42.42.2(pid=26176): stdout: | (launched: 2022-12-09_10:24:12.195510) 10:24:15.756616 run osmo-hlr_10.42.42.2(pid=26176): stderr: | 20221209102412396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102412396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102412396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102412396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102412396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102412396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102412408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102412417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102412417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102412417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:15.811192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Terminating (SIGTERM) 10:24:15.860050 run iperf3-srv_10.42.42.10(pid=26166): Terminating (SIGTERM) 10:24:15.926767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Terminating (SIGTERM) 10:24:15.971939 run iperf3-srv_10.42.42.10(pid=26168): Terminating (SIGTERM) 10:24:16.031064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminating (SIGTERM) 10:24:16.082843 run iperf3-srv_10.42.42.10(pid=26170): Terminating (SIGTERM) 10:24:16.128312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26171): Terminating (SIGTERM) 10:24:16.172426 run iperf3-srv_10.42.42.10(pid=26172): Terminating (SIGTERM) 10:24:16.216506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26175): Terminating (SIGTERM) 10:24:16.260622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26178): Terminating (SIGTERM) 10:24:16.304836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26181): Terminating (SIGTERM) 10:24:16.349207 --- ParallelTerminationStrategy: PID 26165 died... 10:24:16.369758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Terminated: ok {rc=0} 10:24:16.418842 --- ParallelTerminationStrategy: PID 26166 died... 10:24:16.439304 run iperf3-srv_10.42.42.10(pid=26166): Terminated {rc=256} 10:24:16.487597 --- ParallelTerminationStrategy: PID 26167 died... 10:24:16.510716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Terminated: ok {rc=0} 10:24:16.568682 --- ParallelTerminationStrategy: PID 26168 died... 10:24:16.593057 run iperf3-srv_10.42.42.10(pid=26168): Terminated {rc=256} 10:24:16.652668 --- ParallelTerminationStrategy: PID 26169 died... 10:24:16.678874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminated: ok {rc=0} 10:24:16.736363 --- ParallelTerminationStrategy: PID 26170 died... 10:24:16.762952 run iperf3-srv_10.42.42.10(pid=26170): Terminated {rc=256} 10:24:16.818383 --- ParallelTerminationStrategy: PID 26171 died... 10:24:16.839256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26171): Terminated: ok {rc=0} 10:24:16.888418 --- ParallelTerminationStrategy: PID 26172 died... 10:24:16.909304 run iperf3-srv_10.42.42.10(pid=26172): Terminated {rc=256} 10:24:16.957949 --- ParallelTerminationStrategy: PID 26175 died... 10:24:16.978530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26175): Terminated: ok {rc=0} 10:24:17.027392 --- ParallelTerminationStrategy: PID 26178 died... 10:24:17.048089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26178): Terminated: ok {rc=0} 10:24:17.097233 --- ParallelTerminationStrategy: PID 26181 died... 10:24:17.117794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26181): Terminated: ok {rc=0} 10:24:17.209719 bus /gobi_4: Setting Powered False 10:24:18.310202 bus /gobi_4: Setting Powered False 10:24:19.428845 bus /gobi_1: Setting Powered False 10:24:20.527803 bus /gobi_1: Setting Powered False 10:24:21.648457 bus /gobi_0: Setting Powered False 10:24:22.749102 bus /gobi_0: Setting Powered False 10:24:23.866763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:24:24.971687 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:24.983463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:24:25.054688 tst ping.py: using LAC 20810 10:24:25.174870 tst ping.py: using RAC 155 10:24:25.295884 tst ping.py: using CellId 20810 10:24:25.414151 tst ping.py: using BVCI 20811 10:24:25.525604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.536465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.547365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.558305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.569037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.579882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.590788 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:25.601597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:24:25.717822 tst ping.py:19: start network... 10:24:25.917640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:26.386790 run create_hlr_db(pid=26183): Launched 10:24:26.512627 bus /gobi_6: Setting Powered False 10:24:27.572546 run create_hlr_db(pid=26183): Terminated: ok {rc=0} 10:24:28.015867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26185): Launched 10:24:28.341559 run osmo-hlr_10.42.42.2(pid=26186): Launched 10:24:28.468025 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:29.030550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26188): Launched 10:24:29.355347 run osmo-stp_10.42.42.5(pid=26189): Launched 10:24:29.480225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:30.039641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26191): Launched 10:24:30.165676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:30.438744 run patchelf(pid=26192): Launched 10:24:30.620227 run osmo-stp_10.42.42.5(pid=26189): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26189)] 10:24:30.757198 run osmo-stp_10.42.42.5(pid=26189): stdout: | (launched: 2022-12-09_10:24:29.295217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:30.923568 run osmo-stp_10.42.42.5(pid=26189): stderr: | 20221209102429486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102429486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102429487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102429487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102429487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102429487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102429488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:31.070451 run osmo-stp_10.42.42.5(pid=26189): stdout: | (launched: 2022-12-09_10:24:29.295217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:31.206440 run osmo-stp_10.42.42.5(pid=26189): stderr: | 20221209102429486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102429486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102429487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102429487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102429487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102429487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102429488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:31.367781 run patchelf(pid=26192): Terminating (SIGINT) 10:24:31.552740 run patchelf(pid=26192): Terminated: ok {rc=0} 10:24:31.687268 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26189): Process ended prematurely: osmo-stp_10.42.42.5(pid=26189) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26189)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 10:24:31.698125 tst ping.py:22: Test FAILED (6.7 sec) 10:24:31.730595 run osmo-hlr_10.42.42.2(pid=26186): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26186)] 10:24:31.784523 run osmo-hlr_10.42.42.2(pid=26186): stdout: | (launched: 2022-12-09_10:24:28.281582) 10:24:31.839764 run osmo-hlr_10.42.42.2(pid=26186): stderr: | 20221209102428481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102428481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102428481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102428481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102428481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102428481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102428500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102428509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102428510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102428510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:31.895361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26185): Terminating (SIGTERM) 10:24:31.940075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26188): Terminating (SIGTERM) 10:24:31.985643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26191): Terminating (SIGTERM) 10:24:32.032024 --- ParallelTerminationStrategy: PID 26185 died... 10:24:32.052781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26185): Terminated: ok {rc=0} 10:24:32.102941 --- ParallelTerminationStrategy: PID 26188 died... 10:24:32.123610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26188): Terminated: ok {rc=0} 10:24:32.173963 --- ParallelTerminationStrategy: PID 26191 died... 10:24:32.194035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26191): Terminated: ok {rc=0} 10:24:32.283314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:24:33.370101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.381939 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:24:33.456661 tst ping_idle_ping.py: using LAC 20811 10:24:33.574831 tst ping_idle_ping.py: using RAC 156 10:24:33.692155 tst ping_idle_ping.py: using CellId 20811 10:24:33.809068 tst ping_idle_ping.py: using BVCI 20812 10:24:33.918731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.930047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.941109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.952272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.963409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.974689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.986031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:24:33.997168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:24:34.111309 tst ping_idle_ping.py:24: start network... 10:24:34.313653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:34.794470 run create_hlr_db(pid=26193): Launched 10:24:34.920755 bus /gobi_6: Setting Powered False 10:24:35.981217 run create_hlr_db(pid=26193): Terminated: ok {rc=0} 10:24:36.423925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26195): Launched 10:24:36.749564 run osmo-hlr_10.42.42.2(pid=26196): Launched 10:24:36.878207 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:37.440220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26198): Launched 10:24:37.763455 run osmo-stp_10.42.42.5(pid=26199): Launched 10:24:37.888195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:38.446373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Launched 10:24:38.571854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:38.845969 run patchelf(pid=26202): Launched 10:24:39.026738 run osmo-stp_10.42.42.5(pid=26199): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26199)] 10:24:39.163973 run osmo-stp_10.42.42.5(pid=26199): stdout: | (launched: 2022-12-09_10:24:37.703338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:39.302231 run osmo-stp_10.42.42.5(pid=26199): stderr: | 20221209102437893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102437893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102437893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102437894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102437894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102437894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102437894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:39.440754 run osmo-stp_10.42.42.5(pid=26199): stdout: | (launched: 2022-12-09_10:24:37.703338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:39.575033 run osmo-stp_10.42.42.5(pid=26199): stderr: | 20221209102437893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102437893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102437893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102437894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102437894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102437894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102437894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:39.732299 run patchelf(pid=26202): Terminating (SIGINT) 10:24:39.913550 run patchelf(pid=26202): Terminated: ok {rc=0} 10:24:40.043962 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26199): Process ended prematurely: osmo-stp_10.42.42.5(pid=26199) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26199)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:24:40.054056 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:24:40.083276 run osmo-hlr_10.42.42.2(pid=26196): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26196)] 10:24:40.134023 run osmo-hlr_10.42.42.2(pid=26196): stdout: | (launched: 2022-12-09_10:24:36.689485) 10:24:40.186946 run osmo-hlr_10.42.42.2(pid=26196): stderr: | 20221209102436888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102436888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102436888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102436888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102436888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102436888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102436900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102436908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102436908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102436908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:40.239909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26195): Terminating (SIGTERM) 10:24:40.282542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26198): Terminating (SIGTERM) 10:24:40.325293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Terminating (SIGTERM) 10:24:40.368001 --- ParallelTerminationStrategy: PID 26195 died... 10:24:40.388116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26195): Terminated: ok {rc=0} 10:24:40.435158 --- ParallelTerminationStrategy: PID 26198 died... 10:24:40.454901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26198): Terminated: ok {rc=0} 10:24:40.501684 --- ParallelTerminationStrategy: PID 26201 died... 10:24:40.521432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Terminated: ok {rc=0} 10:24:40.611306 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:24:41.920777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:41.928058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:24:41.963220 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:24:42.003714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:24:42.092571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:24:42.127128 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:24:42.166258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:24:42.763046 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:24:42.817346 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:42.828829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:24:42.901415 tst cs_paging_gprs_active.py: using LAC 20812 10:24:43.023045 tst cs_paging_gprs_active.py: using RAC 157 10:24:43.146078 tst cs_paging_gprs_active.py: using CellId 20812 10:24:43.268012 tst cs_paging_gprs_active.py: using BVCI 20813 10:24:43.381424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.392415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.403308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.414653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.425755 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.436643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.447641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.458642 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:43.469687 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:24:43.590206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:24:43.709074 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:24:43.914504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:44.222427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26206): Launched 10:24:44.492926 run iperf3-srv_10.42.42.10(pid=26207): Launched 10:24:44.610594 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:24:44.815659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:45.125042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26208): Launched 10:24:45.392706 run iperf3-srv_10.42.42.10(pid=26209): Launched 10:24:45.508682 tst cs_paging_gprs_active.py:38: start network... 10:24:45.719838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:46.210301 run create_hlr_db(pid=26210): Launched 10:24:46.365194 bus /gobi_6: Setting Powered False 10:24:47.426252 run create_hlr_db(pid=26210): Terminated: ok {rc=0} 10:24:47.851936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26212): Launched 10:24:48.158979 run osmo-hlr_10.42.42.2(pid=26213): Launched 10:24:48.275442 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:48.818929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26215): Launched 10:24:49.125419 run osmo-stp_10.42.42.5(pid=26216): Launched 10:24:49.243351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:49.774592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26218): Launched 10:24:49.893794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:50.153056 run patchelf(pid=26219): Launched 10:24:50.323546 run osmo-stp_10.42.42.5(pid=26216): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26216)] 10:24:50.463568 run osmo-stp_10.42.42.5(pid=26216): stdout: | (launched: 2022-12-09_10:24:49.068734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:50.604267 run osmo-stp_10.42.42.5(pid=26216): stderr: | 20221209102449238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102449238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102449238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102449239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102449239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102449239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102449239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:50.744699 run osmo-stp_10.42.42.5(pid=26216): stdout: | (launched: 2022-12-09_10:24:49.068734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:50.880200 run osmo-stp_10.42.42.5(pid=26216): stderr: | 20221209102449238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102449238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102449238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102449239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102449239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102449239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102449239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:51.040135 run patchelf(pid=26219): Terminating (SIGINT) 10:24:51.223556 run patchelf(pid=26219): Terminated: ok {rc=0} 10:24:51.356599 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26216): Process ended prematurely: osmo-stp_10.42.42.5(pid=26216) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26216)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:24:51.367104 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:24:51.398084 run osmo-hlr_10.42.42.2(pid=26213): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26213)] 10:24:51.450054 run osmo-hlr_10.42.42.2(pid=26213): stdout: | (launched: 2022-12-09_10:24:48.102452) 10:24:51.503233 run osmo-hlr_10.42.42.2(pid=26213): stderr: | 20221209102448277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102448277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102448277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102448277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102448277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102448278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102448289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102448298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102448298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102448298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:51.556857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26206): Terminating (SIGTERM) 10:24:51.600216 run iperf3-srv_10.42.42.10(pid=26207): Terminating (SIGTERM) 10:24:51.643275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26208): Terminating (SIGTERM) 10:24:51.686706 run iperf3-srv_10.42.42.10(pid=26209): Terminating (SIGTERM) 10:24:51.729770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26212): Terminating (SIGTERM) 10:24:51.772707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26215): Terminating (SIGTERM) 10:24:51.816223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26218): Terminating (SIGTERM) 10:24:51.859669 --- ParallelTerminationStrategy: PID 26206 died... 10:24:51.879810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26206): Terminated: ok {rc=0} 10:24:51.928431 --- ParallelTerminationStrategy: PID 26207 died... 10:24:51.948173 run iperf3-srv_10.42.42.10(pid=26207): Terminated {rc=256} 10:24:51.996165 --- ParallelTerminationStrategy: PID 26208 died... 10:24:52.015962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26208): Terminated: ok {rc=0} 10:24:52.063899 --- ParallelTerminationStrategy: PID 26209 died... 10:24:52.083554 run iperf3-srv_10.42.42.10(pid=26209): Terminated {rc=256} 10:24:52.131365 --- ParallelTerminationStrategy: PID 26212 died... 10:24:52.151050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26212): Terminated: ok {rc=0} 10:24:52.198111 --- ParallelTerminationStrategy: PID 26215 died... 10:24:52.218996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26215): Terminated: ok {rc=0} 10:24:52.266829 --- ParallelTerminationStrategy: PID 26218 died... 10:24:52.286509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26218): Terminated: ok {rc=0} 10:24:52.377530 bus /gobi_0: Setting Powered False 10:24:53.477782 bus /gobi_0: Setting Powered False 10:24:54.595668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:24:55.747494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:55.759734 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:24:55.836236 tst iperf3.py: using LAC 20813 10:24:55.973871 tst iperf3.py: using RAC 158 10:24:56.104249 tst iperf3.py: using CellId 20813 10:24:56.226735 tst iperf3.py: using BVCI 20814 10:24:56.340531 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.351734 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.362898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.374118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.385270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.396349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.407654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.418752 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:24:56.429998 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:24:56.544106 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:24:56.749884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:57.056020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26220): Launched 10:24:57.323442 run iperf3-srv_10.42.42.10(pid=26221): Launched 10:24:57.438380 tst iperf3.py:8: start network... 10:24:57.641685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:58.114035 run create_hlr_db(pid=26222): Launched 10:24:58.240010 bus /gobi_6: Setting Powered False 10:24:59.299819 run create_hlr_db(pid=26222): Terminated: ok {rc=0} 10:24:59.744773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Launched 10:25:00.071186 run osmo-hlr_10.42.42.2(pid=26225): Launched 10:25:00.196130 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:00.761524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26227): Launched 10:25:01.121337 run osmo-stp_10.42.42.5(pid=26228): Launched 10:25:01.344716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:02.015770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26233): Launched 10:25:02.148812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:02.426314 run patchelf(pid=26234): Launched 10:25:02.609908 run osmo-stp_10.42.42.5(pid=26228): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26228)] 10:25:02.748565 run osmo-stp_10.42.42.5(pid=26228): stdout: | (launched: 2022-12-09_10:25:01.061761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:02.889265 run osmo-stp_10.42.42.5(pid=26228): stderr: | 20221209102501366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102501366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102501366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102501367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102501367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102501367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102501367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:03.029708 run osmo-stp_10.42.42.5(pid=26228): stdout: | (launched: 2022-12-09_10:25:01.061761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:03.164274 run osmo-stp_10.42.42.5(pid=26228): stderr: | 20221209102501366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102501366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102501366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102501367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102501367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102501367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102501367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:03.324009 run patchelf(pid=26234): Terminating (SIGINT) 10:25:03.507120 run patchelf(pid=26234): Terminated: ok {rc=0} 10:25:03.638888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26228): Process ended prematurely: osmo-stp_10.42.42.5(pid=26228) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26228)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 10:25:03.649141 tst iperf3.py:8: Test FAILED (7.9 sec) 10:25:03.679057 run osmo-hlr_10.42.42.2(pid=26225): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26225)] 10:25:03.730449 run osmo-hlr_10.42.42.2(pid=26225): stdout: | (launched: 2022-12-09_10:25:00.012046) 10:25:03.783655 run osmo-hlr_10.42.42.2(pid=26225): stderr: | 20221209102500206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102500206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102500206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102500206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102500206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102500206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102500219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102500230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102500230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102500230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:03.837484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26220): Terminating (SIGTERM) 10:25:03.880638 run iperf3-srv_10.42.42.10(pid=26221): Terminating (SIGTERM) 10:25:03.923617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Terminating (SIGTERM) 10:25:03.966700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26227): Terminating (SIGTERM) 10:25:04.009739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26233): Terminating (SIGTERM) 10:25:04.052836 --- ParallelTerminationStrategy: PID 26220 died... 10:25:04.073173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26220): Terminated: ok {rc=0} 10:25:04.120752 --- ParallelTerminationStrategy: PID 26221 died... 10:25:04.140705 run iperf3-srv_10.42.42.10(pid=26221): Terminated {rc=256} 10:25:04.188086 --- ParallelTerminationStrategy: PID 26224 died... 10:25:04.207784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Terminated: ok {rc=0} 10:25:04.255254 --- ParallelTerminationStrategy: PID 26227 died... 10:25:04.275186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26227): Terminated: ok {rc=0} 10:25:04.322387 --- ParallelTerminationStrategy: PID 26233 died... 10:25:04.342491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26233): Terminated: ok {rc=0} 10:25:04.432341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:25:05.585493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:05.597818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:25:05.673102 tst iperf3m4.py: using LAC 20814 10:25:05.800256 tst iperf3m4.py: using RAC 159 10:25:05.928004 tst iperf3m4.py: using CellId 20814 10:25:06.054113 tst iperf3m4.py: using BVCI 20815 10:25:06.173340 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.184731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.196042 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.207632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.219176 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.230724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.242620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.254559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:06.266839 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:25:06.385472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:25:06.505037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:25:06.622028 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:25:06.742285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:25:06.964677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:07.294535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26235): Launched 10:25:07.581552 run iperf3-srv_10.42.42.10(pid=26236): Launched 10:25:07.707104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:25:07.929035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:08.258722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26237): Launched 10:25:08.545665 run iperf3-srv_10.42.42.10(pid=26238): Launched 10:25:08.671301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:25:08.893132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:09.222858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26239): Launched 10:25:09.510008 run iperf3-srv_10.42.42.10(pid=26240): Launched 10:25:09.635115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:25:09.855242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:10.183256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26241): Launched 10:25:10.469640 run iperf3-srv_10.42.42.10(pid=26242): Launched 10:25:10.594671 tst iperf3m4.py:8: start network... 10:25:10.815936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:11.325315 run create_hlr_db(pid=26243): Launched 10:25:11.449968 bus /gobi_6: Setting Powered False 10:25:12.514686 run create_hlr_db(pid=26243): Terminated: ok {rc=0} 10:25:12.969665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26245): Launched 10:25:13.298152 run osmo-hlr_10.42.42.2(pid=26246): Launched 10:25:13.423525 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:13.994389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26248): Launched 10:25:14.322102 run osmo-stp_10.42.42.5(pid=26249): Launched 10:25:14.448450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:15.011323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26251): Launched 10:25:15.136228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:15.411953 run patchelf(pid=26252): Launched 10:25:15.594176 run osmo-stp_10.42.42.5(pid=26249): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26249)] 10:25:15.732734 run osmo-stp_10.42.42.5(pid=26249): stdout: | (launched: 2022-12-09_10:25:14.262527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:15.881180 run osmo-stp_10.42.42.5(pid=26249): stderr: | 20221209102514451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102514451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102514451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102514451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102514452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102514452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102514452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:16.028528 run osmo-stp_10.42.42.5(pid=26249): stdout: | (launched: 2022-12-09_10:25:14.262527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:16.166437 run osmo-stp_10.42.42.5(pid=26249): stderr: | 20221209102514451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102514451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102514451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102514451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102514452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102514452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102514452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:16.330040 run patchelf(pid=26252): Terminating (SIGINT) 10:25:16.517787 run patchelf(pid=26252): Terminated: ok {rc=0} 10:25:16.653837 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26249): Process ended prematurely: osmo-stp_10.42.42.5(pid=26249) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26249)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:25:16.665470 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:25:16.698467 run osmo-hlr_10.42.42.2(pid=26246): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26246)] 10:25:16.752034 run osmo-hlr_10.42.42.2(pid=26246): stdout: | (launched: 2022-12-09_10:25:13.238219) 10:25:16.807183 run osmo-hlr_10.42.42.2(pid=26246): stderr: | 20221209102513434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102513434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102513434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102513434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102513434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102513434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102513446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102513457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102513457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102513457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:16.862571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26235): Terminating (SIGTERM) 10:25:16.907474 run iperf3-srv_10.42.42.10(pid=26236): Terminating (SIGTERM) 10:25:16.953541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26237): Terminating (SIGTERM) 10:25:16.998579 run iperf3-srv_10.42.42.10(pid=26238): Terminating (SIGTERM) 10:25:17.043325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26239): Terminating (SIGTERM) 10:25:17.088591 run iperf3-srv_10.42.42.10(pid=26240): Terminating (SIGTERM) 10:25:17.134494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26241): Terminating (SIGTERM) 10:25:17.179161 run iperf3-srv_10.42.42.10(pid=26242): Terminating (SIGTERM) 10:25:17.224160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26245): Terminating (SIGTERM) 10:25:17.267164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26248): Terminating (SIGTERM) 10:25:17.310001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26251): Terminating (SIGTERM) 10:25:17.353050 --- ParallelTerminationStrategy: PID 26235 died... 10:25:17.373337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26235): Terminated: ok {rc=0} 10:25:17.421281 --- ParallelTerminationStrategy: PID 26236 died... 10:25:17.441238 run iperf3-srv_10.42.42.10(pid=26236): Terminated {rc=256} 10:25:17.488280 --- ParallelTerminationStrategy: PID 26237 died... 10:25:17.508314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26237): Terminated: ok {rc=0} 10:25:17.555522 --- ParallelTerminationStrategy: PID 26238 died... 10:25:17.575396 run iperf3-srv_10.42.42.10(pid=26238): Terminated {rc=256} 10:25:17.622461 --- ParallelTerminationStrategy: PID 26239 died... 10:25:17.642327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26239): Terminated: ok {rc=0} 10:25:17.689749 --- ParallelTerminationStrategy: PID 26240 died... 10:25:17.709809 run iperf3-srv_10.42.42.10(pid=26240): Terminated {rc=256} 10:25:17.757360 --- ParallelTerminationStrategy: PID 26241 died... 10:25:17.777324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26241): Terminated: ok {rc=0} 10:25:17.825294 --- ParallelTerminationStrategy: PID 26242 died... 10:25:17.845109 run iperf3-srv_10.42.42.10(pid=26242): Terminated {rc=256} 10:25:17.892415 --- ParallelTerminationStrategy: PID 26245 died... 10:25:17.912369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26245): Terminated: ok {rc=0} 10:25:17.959842 --- ParallelTerminationStrategy: PID 26248 died... 10:25:17.979842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26248): Terminated: ok {rc=0} 10:25:18.027390 --- ParallelTerminationStrategy: PID 26251 died... 10:25:18.047422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26251): Terminated: ok {rc=0} 10:25:18.137498 bus /gobi_4: Setting Powered False 10:25:19.238310 bus /gobi_4: Setting Powered False 10:25:20.356574 bus /gobi_1: Setting Powered False 10:25:21.456030 bus /gobi_1: Setting Powered False 10:25:22.575022 bus /gobi_0: Setting Powered False 10:25:23.676586 bus /gobi_0: Setting Powered False 10:25:24.792806 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:25:25.897348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:25.909766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:25:25.983477 tst ping.py: using LAC 20815 10:25:26.111646 tst ping.py: using RAC 160 10:25:26.237356 tst ping.py: using CellId 20815 10:25:26.368605 tst ping.py: using BVCI 20816 10:25:26.487443 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.499311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.510704 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.522314 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.533845 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.545520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.557280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:26.568804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:25:26.683603 tst ping.py:19: start network... 10:25:26.882801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:27.347670 run create_hlr_db(pid=26253): Launched 10:25:27.470851 bus /gobi_6: Setting Powered False 10:25:28.530724 run create_hlr_db(pid=26253): Terminated: ok {rc=0} 10:25:28.971359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26255): Launched 10:25:29.294158 run osmo-hlr_10.42.42.2(pid=26256): Launched 10:25:29.416916 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:29.980438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26258): Launched 10:25:30.301856 run osmo-stp_10.42.42.5(pid=26259): Launched 10:25:30.424392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:30.989436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26261): Launched 10:25:31.120256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:31.397788 run patchelf(pid=26262): Launched 10:25:31.585201 run osmo-stp_10.42.42.5(pid=26259): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26259)] 10:25:31.716505 run osmo-stp_10.42.42.5(pid=26259): stdout: | (launched: 2022-12-09_10:25:30.242794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:31.851231 run osmo-stp_10.42.42.5(pid=26259): stderr: | 20221209102530430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102530430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102530430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102530431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102530431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102530431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102530431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:31.984862 run osmo-stp_10.42.42.5(pid=26259): stdout: | (launched: 2022-12-09_10:25:30.242794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:32.111804 run osmo-stp_10.42.42.5(pid=26259): stderr: | 20221209102530430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102530430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102530430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102530431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102530431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102530431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102530431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:32.260218 run patchelf(pid=26262): Terminating (SIGINT) 10:25:32.428926 run patchelf(pid=26262): Terminated: ok {rc=0} 10:25:32.550635 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26259): Process ended prematurely: osmo-stp_10.42.42.5(pid=26259) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26259)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 10:25:32.559847 tst ping.py:22: Test FAILED (6.7 sec) 10:25:32.587420 run osmo-hlr_10.42.42.2(pid=26256): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26256)] 10:25:32.635869 run osmo-hlr_10.42.42.2(pid=26256): stdout: | (launched: 2022-12-09_10:25:29.234901) 10:25:32.686373 run osmo-hlr_10.42.42.2(pid=26256): stderr: | 20221209102529429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102529429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102529429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102529429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102529429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102529429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102529442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102529450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102529450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102529450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:32.737059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26255): Terminating (SIGTERM) 10:25:32.777860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26258): Terminating (SIGTERM) 10:25:32.818603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26261): Terminating (SIGTERM) 10:25:32.859455 --- ParallelTerminationStrategy: PID 26255 died... 10:25:32.878931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26255): Terminated: ok {rc=0} 10:25:32.923765 --- ParallelTerminationStrategy: PID 26258 died... 10:25:32.943047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26258): Terminated: ok {rc=0} 10:25:32.988143 --- ParallelTerminationStrategy: PID 26261 died... 10:25:33.007254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26261): Terminated: ok {rc=0} 10:25:33.092574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:25:34.181711 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.194435 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:25:34.273201 tst ping_idle_ping.py: using LAC 20816 10:25:34.414400 tst ping_idle_ping.py: using RAC 161 10:25:34.547043 tst ping_idle_ping.py: using CellId 20816 10:25:34.675745 tst ping_idle_ping.py: using BVCI 20817 10:25:34.795887 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.807450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.819254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.831302 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.843245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.855267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.868416 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:25:34.879834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:25:34.998663 tst ping_idle_ping.py:24: start network... 10:25:35.198972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:35.668359 run create_hlr_db(pid=26263): Launched 10:25:35.794640 bus /gobi_6: Setting Powered False 10:25:36.855263 run create_hlr_db(pid=26263): Terminated: ok {rc=0} 10:25:37.276141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26265): Launched 10:25:37.576407 run osmo-hlr_10.42.42.2(pid=26266): Launched 10:25:37.691431 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:38.210036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26268): Launched 10:25:38.510764 run osmo-stp_10.42.42.5(pid=26269): Launched 10:25:38.626772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:39.147776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26271): Launched 10:25:39.264468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:39.520590 run patchelf(pid=26272): Launched 10:25:39.688160 run osmo-stp_10.42.42.5(pid=26269): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26269)] 10:25:39.815591 run osmo-stp_10.42.42.5(pid=26269): stdout: | (launched: 2022-12-09_10:25:38.455450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:39.944615 run osmo-stp_10.42.42.5(pid=26269): stderr: | 20221209102538623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102538623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102538623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102538624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102538624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102538624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102538624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:40.074388 run osmo-stp_10.42.42.5(pid=26269): stdout: | (launched: 2022-12-09_10:25:38.455450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:40.198110 run osmo-stp_10.42.42.5(pid=26269): stderr: | 20221209102538623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102538623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102538623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102538624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102538624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102538624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102538624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:40.344217 run patchelf(pid=26272): Terminating (SIGINT) 10:25:40.513231 run patchelf(pid=26272): Terminated: ok {rc=0} 10:25:40.634936 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26269): Process ended prematurely: osmo-stp_10.42.42.5(pid=26269) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26269)] [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:25:40.643912 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:25:40.670966 run osmo-hlr_10.42.42.2(pid=26266): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26266)] 10:25:40.718940 run osmo-hlr_10.42.42.2(pid=26266): stdout: | (launched: 2022-12-09_10:25:37.521486) 10:25:40.769177 run osmo-hlr_10.42.42.2(pid=26266): stderr: | 20221209102537694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102537694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102537694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102537694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102537694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102537694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102537706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102537715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102537715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102537716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:40.819365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26265): Terminating (SIGTERM) 10:25:40.859583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26268): Terminating (SIGTERM) 10:25:40.899729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26271): Terminating (SIGTERM) 10:25:40.940599 --- ParallelTerminationStrategy: PID 26265 died... 10:25:40.959806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26265): Terminated: ok {rc=0} 10:25:41.004698 --- ParallelTerminationStrategy: PID 26268 died... 10:25:41.023741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26268): Terminated: ok {rc=0} 10:25:41.067957 --- ParallelTerminationStrategy: PID 26271 died... 10:25:41.086842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26271): Terminated: ok {rc=0} 10:25:41.174603 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:25:42.492378 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:42.500317 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:25:42.534165 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:25:42.568037 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:25:42.622501 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:25:42.656104 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:25:42.690018 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:25:43.251108 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:25:43.257365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.269176 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:25:43.342766 tst switch_tch_pdch.py: using LAC 20817 10:25:43.471270 tst switch_tch_pdch.py: using RAC 162 10:25:43.599329 tst switch_tch_pdch.py: using CellId 20817 10:25:43.726343 tst switch_tch_pdch.py: using BVCI 20818 10:25:43.844022 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.855741 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.867458 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.879697 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.891937 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.904153 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.917543 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:25:43.929548 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:25:44.051433 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:25:44.171261 tst switch_tch_pdch.py:51: start network... 10:25:44.386830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:44.885639 run create_hlr_db(pid=26277): Launched 10:25:45.011620 bus /gobi_6: Setting Powered False 10:25:46.084587 run create_hlr_db(pid=26277): Terminated: ok {rc=0} 10:25:46.559241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26279): Launched 10:25:46.884375 run osmo-hlr_10.42.42.2(pid=26280): Launched 10:25:47.126638 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:47.704238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26282): Launched 10:25:48.003972 run osmo-stp_10.42.42.5(pid=26283): Launched 10:25:48.118481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:48.633858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26285): Launched 10:25:48.748883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:49.002567 run patchelf(pid=26286): Launched 10:25:49.171903 run osmo-stp_10.42.42.5(pid=26283): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26283)] 10:25:49.297935 run osmo-stp_10.42.42.5(pid=26283): stdout: | (launched: 2022-12-09_10:25:47.948683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:49.425531 run osmo-stp_10.42.42.5(pid=26283): stderr: | 20221209102548115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102548116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102548116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102548116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102548117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102548117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102548117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:49.553482 run osmo-stp_10.42.42.5(pid=26283): stdout: | (launched: 2022-12-09_10:25:47.948683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:49.675256 run osmo-stp_10.42.42.5(pid=26283): stderr: | 20221209102548115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102548116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102548116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102548116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102548117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102548117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102548117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:49.819518 run patchelf(pid=26286): Terminating (SIGINT) 10:25:49.985988 run patchelf(pid=26286): Terminated: ok {rc=0} 10:25:50.106904 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26283): Process ended prematurely: osmo-stp_10.42.42.5(pid=26283) [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26283)] [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:25:50.115902 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:25:50.142782 run osmo-hlr_10.42.42.2(pid=26280): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26280)] 10:25:50.190718 run osmo-hlr_10.42.42.2(pid=26280): stdout: | (launched: 2022-12-09_10:25:46.826523) 10:25:50.240348 run osmo-hlr_10.42.42.2(pid=26280): stderr: | 20221209102547121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102547121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102547121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102547121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102547121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102547121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102547149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102547172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102547172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102547173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:50.290639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26279): Terminating (SIGTERM) 10:25:50.330540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26282): Terminating (SIGTERM) 10:25:50.370350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26285): Terminating (SIGTERM) 10:25:50.410283 --- ParallelTerminationStrategy: PID 26279 died... 10:25:50.429462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26279): Terminated: ok {rc=0} 10:25:50.473754 --- ParallelTerminationStrategy: PID 26282 died... 10:25:50.492504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26282): Terminated: ok {rc=0} 10:25:50.536708 --- ParallelTerminationStrategy: PID 26285 died... 10:25:50.555626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26285): Terminated: ok {rc=0} 10:25:50.643429 bus /gobi_0: Setting Powered False 10:25:51.745581 bus /gobi_0: Setting Powered False 10:25:52.862711 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:25:54.118301 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:54.124512 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:25:54.158000 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:25:54.192029 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:25:54.244013 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:25:54.277067 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:25:54.310566 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:25:54.867900 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:25:54.872783 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:54.883825 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:25:54.953382 tst switch_tch_pdch.py: using LAC 20818 10:25:55.071806 tst switch_tch_pdch.py: using RAC 163 10:25:55.191127 tst switch_tch_pdch.py: using CellId 20818 10:25:55.311384 tst switch_tch_pdch.py: using BVCI 20819 10:25:55.421451 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.432327 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.443168 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.454023 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.464747 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.475626 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.486645 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:25:55.497483 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:25:55.614243 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:25:55.732824 tst switch_tch_pdch.py:51: start network... 10:25:55.931627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:56.374355 run create_hlr_db(pid=26291): Launched 10:25:56.497937 bus /gobi_6: Setting Powered False 10:25:57.557682 run create_hlr_db(pid=26291): Terminated: ok {rc=0} 10:25:57.969454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26293): Launched 10:25:58.293296 run osmo-hlr_10.42.42.2(pid=26294): Launched 10:25:58.417864 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:58.943294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26296): Launched 10:25:59.263463 run osmo-stp_10.42.42.5(pid=26297): Launched 10:25:59.386644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:59.912229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26299): Launched 10:26:00.035342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:26:00.305830 run patchelf(pid=26300): Launched 10:26:00.487249 run osmo-stp_10.42.42.5(pid=26297): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26297)] 10:26:00.624339 run osmo-stp_10.42.42.5(pid=26297): stdout: | (launched: 2022-12-09_10:25:59.205294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:00.762962 run osmo-stp_10.42.42.5(pid=26297): stderr: | 20221209102559393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102559393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102559393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102559394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102559394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102559394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102559394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:00.919726 run osmo-stp_10.42.42.5(pid=26297): stdout: | (launched: 2022-12-09_10:25:59.205294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:01.054602 run osmo-stp_10.42.42.5(pid=26297): stderr: | 20221209102559393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102559393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102559393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102559394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102559394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102559394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102559394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:01.206456 run patchelf(pid=26300): Terminating (SIGINT) 10:26:01.379818 run patchelf(pid=26300): Terminated: ok {rc=0} 10:26:01.505276 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26297): Process ended prematurely: osmo-stp_10.42.42.5(pid=26297) [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26297)] [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:26:01.515413 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:26:01.544317 run osmo-hlr_10.42.42.2(pid=26294): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26294)] 10:26:01.595469 run osmo-hlr_10.42.42.2(pid=26294): stdout: | (launched: 2022-12-09_10:25:58.234452) 10:26:01.647362 run osmo-hlr_10.42.42.2(pid=26294): stderr: | 20221209102558428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102558429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102558429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102558429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102558429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102558429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102558443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102558452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102558452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102558452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:01.701364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26293): Terminating (SIGTERM) 10:26:01.744767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26296): Terminating (SIGTERM) 10:26:01.790509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26299): Terminating (SIGTERM) 10:26:01.834842 --- ParallelTerminationStrategy: PID 26293 died... 10:26:01.854993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26293): Terminated: ok {rc=0} 10:26:01.902124 --- ParallelTerminationStrategy: PID 26296 died... 10:26:01.921361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26296): Terminated: ok {rc=0} 10:26:01.967832 --- ParallelTerminationStrategy: PID 26299 died... 10:26:01.987399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26299): Terminated: ok {rc=0} 10:26:02.076754 bus /gobi_0: Setting Powered False 10:26:03.179677 bus /gobi_0: Setting Powered False 10:26:04.297871 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:trx-umtrx --------------------------------------------------------------------- 10:26:05.554616 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:05.558836 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:26:05.592353 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:26:05.599373 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:26:05.652854 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:26:05.685821 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:26:05.692697 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:26:06.230868 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:26:06.235981 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:26:06.247048 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:26:06.295411 tst mo_mt_sms.py: using LAC 20819 10:26:06.422784 tst mo_mt_sms.py: using RAC 164 10:26:06.547589 tst mo_mt_sms.py: using CellId 20819 10:26:06.666682 tst mo_mt_sms.py: using BVCI 20820 10:26:06.775287 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:26:06.892499 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:26:07.008379 tst mo_mt_sms.py:9: start nitb and bts... 10:26:07.226324 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:26:07.882284 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26304): Launched 10:26:08.205113 run osmo-nitb_10.42.42.2(pid=26305): Launched 10:26:08.384195 run osmo-nitb_10.42.42.2(pid=26305): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26305)] 10:26:08.528711 run osmo-nitb_10.42.42.2(pid=26305): stdout: | (launched: 2022-12-09_10:26:08.146666) 10:26:08.674442 run osmo-nitb_10.42.42.2(pid=26305): stderr: | (launched: 2022-12-09_10:26:08.194570) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:26:08.819892 run osmo-nitb_10.42.42.2(pid=26305): stdout: | (launched: 2022-12-09_10:26:08.146666) 10:26:08.960464 run osmo-nitb_10.42.42.2(pid=26305): stderr: | (launched: 2022-12-09_10:26:08.194570) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26305) [trial-2358↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26305)] 10:26:09.327396 tst osmo-nitb_10.42.42.2(pid=26305): stdout: | (launched: 2022-12-09_10:26:08.146666) 10:26:09.456905 tst osmo-nitb_10.42.42.2(pid=26305): stderr: | (launched: 2022-12-09_10:26:08.194570) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:26:09.610164 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26305) [trial-2358↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26305)] [trial-2358↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 10:26:09.619365 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:26:09.626627 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26304): Terminating (SIGTERM) 10:26:09.838556 --- ParallelTerminationStrategy: PID 26304 died... 10:26:09.860371 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26304): Terminated: ok {rc=0} 10:26:09.950855 bus /sierra_3: Setting Powered False 10:26:11.051297 bus /sierra_3: Setting Powered False 10:26:12.170570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:trx-umtrx --------------------------------------------------------------------- 10:26:13.369193 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:13.373490 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:26:13.407619 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:26:13.434991 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:26:13.487861 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:26:13.521252 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:26:13.548567 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:26:14.094900 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:26:14.099996 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:14.111012 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:26:14.158737 tst mo_mt_sms.py: using LAC 20820 10:26:14.285367 tst mo_mt_sms.py: using RAC 165 10:26:14.410252 tst mo_mt_sms.py: using CellId 20820 10:26:14.535943 tst mo_mt_sms.py: using BVCI 20821 10:26:14.653925 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:14.664913 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:14.675869 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:14.686995 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:14.698069 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:14.709114 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:26:14.825710 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:26:14.941103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:15.403979 run create_hlr_db(pid=26310): Launched 10:26:15.527798 bus /sierra_2: Setting Powered False 10:26:16.590876 run create_hlr_db(pid=26310): Terminated: ok {rc=0} 10:26:17.050458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26312): Launched 10:26:17.384666 run osmo-hlr_10.42.42.2(pid=26313): Launched 10:26:17.508676 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:18.062738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26315): Launched 10:26:18.386059 run osmo-stp_10.42.42.5(pid=26316): Launched 10:26:18.508734 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:19.092068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26318): Launched 10:26:19.415015 run osmo-msc_10.42.42.6(pid=26319): Launched 10:26:19.596658 run osmo-stp_10.42.42.5(pid=26316): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26316)] 10:26:19.732744 run osmo-stp_10.42.42.5(pid=26316): stdout: | (launched: 2022-12-09_10:26:18.326941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:19.869933 run osmo-stp_10.42.42.5(pid=26316): stderr: | 20221209102618513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102618513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102618514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102618514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102618514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102618515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102618515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:20.004647 run osmo-stp_10.42.42.5(pid=26316): stdout: | (launched: 2022-12-09_10:26:18.326941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:20.133080 run osmo-stp_10.42.42.5(pid=26316): stderr: | 20221209102618513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102618513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102618514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102618514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102618514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102618515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102618515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:20.286801 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26316): Process ended prematurely: osmo-stp_10.42.42.5(pid=26316) [trial-2358↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26316)] [trial-2358↪sms:trx-umtrx↪mo_mt_sms.py:16] 10:26:20.295763 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 10:26:20.324191 run osmo-hlr_10.42.42.2(pid=26313): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26313)] 10:26:20.375448 run osmo-hlr_10.42.42.2(pid=26313): stdout: | (launched: 2022-12-09_10:26:17.326246) 10:26:20.428438 run osmo-hlr_10.42.42.2(pid=26313): stderr: | 20221209102617518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102617518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102617518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102617518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102617518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102617519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102617534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102617544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102617544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102617544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:20.502282 run osmo-msc_10.42.42.6(pid=26319): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26319)] 10:26:20.553587 run osmo-msc_10.42.42.6(pid=26319): stdout: | (launched: 2022-12-09_10:26:19.356225) 10:26:20.606697 run osmo-msc_10.42.42.6(pid=26319): stderr: | 20221209102619673 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102619673 DLGLOBAL DEBUG validating counter group 0x7f3582bebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102619673 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102619673 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102619673 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102619674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102619675 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102619676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102619676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102619676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:20.660032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26312): Terminating (SIGTERM) 10:26:20.702490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26315): Terminating (SIGTERM) 10:26:20.744849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26318): Terminating (SIGTERM) 10:26:20.787536 --- ParallelTerminationStrategy: PID 26312 died... 10:26:20.807791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26312): Terminated: ok {rc=0} 10:26:20.855802 --- ParallelTerminationStrategy: PID 26315 died... 10:26:20.875531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26315): Terminated: ok {rc=0} 10:26:20.922817 --- ParallelTerminationStrategy: PID 26318 died... 10:26:20.942603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26318): Terminated: ok {rc=0} 10:26:21.031511 bus /sierra_3: Setting Powered False 10:26:22.132029 bus /sierra_3: Setting Powered False 10:26:23.249719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 10:26:24.484793 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:24.490227 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:26:24.523048 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:26:24.529705 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:26:24.564627 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:26:24.598973 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:26:24.606200 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:26:25.125696 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:26:25.131082 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:26:25.142479 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:26:25.190953 tst assert_extension.py: using LAC 20821 10:26:25.317245 tst assert_extension.py: using RAC 166 10:26:25.441221 tst assert_extension.py: using CellId 20821 10:26:25.567541 tst assert_extension.py: using BVCI 20822 10:26:25.684214 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:26:25.798056 tst assert_extension.py:10: start nitb and bts... 10:26:25.997372 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:26:26.610646 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26325): Launched 10:26:26.911482 run osmo-nitb_10.42.42.2(pid=26326): Launched 10:26:27.078393 run osmo-nitb_10.42.42.2(pid=26326): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26326)] 10:26:27.212263 run osmo-nitb_10.42.42.2(pid=26326): stdout: | (launched: 2022-12-09_10:26:26.856736) 10:26:27.347745 run osmo-nitb_10.42.42.2(pid=26326): stderr: | (launched: 2022-12-09_10:26:26.901253) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:26:27.484005 run osmo-nitb_10.42.42.2(pid=26326): stdout: | (launched: 2022-12-09_10:26:26.856736) 10:26:27.614529 run osmo-nitb_10.42.42.2(pid=26326): stderr: | (launched: 2022-12-09_10:26:26.901253) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26326) [trial-2358↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26326)] 10:26:28.025845 tst osmo-nitb_10.42.42.2(pid=26326): stdout: | (launched: 2022-12-09_10:26:26.856736) 10:26:28.145755 tst osmo-nitb_10.42.42.2(pid=26326): stderr: | (launched: 2022-12-09_10:26:26.901253) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:26:28.287475 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26326) [trial-2358↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26326)] [trial-2358↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 10:26:28.295870 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:26:28.302550 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26325): Terminating (SIGTERM) 10:26:28.511508 --- ParallelTerminationStrategy: PID 26325 died... 10:26:28.533684 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26325): Terminated: ok {rc=0} 10:26:28.623508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:trx-umtrx --------------------------------------------------------------------- 10:26:29.801360 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:29.805965 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:26:29.841165 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:26:29.869128 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:26:29.904896 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:26:29.938584 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:26:29.966290 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:26:30.494193 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:26:30.499694 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:30.510897 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:26:30.559480 tst assert_extension.py: using LAC 20822 10:26:30.686325 tst assert_extension.py: using RAC 167 10:26:30.814540 tst assert_extension.py: using CellId 20822 10:26:30.969395 tst assert_extension.py: using BVCI 20823 10:26:31.085494 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:31.096762 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:31.108310 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:31.119682 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:31.130577 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:26:31.141995 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:26:31.260668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:31.742194 run create_hlr_db(pid=26330): Launched 10:26:31.904009 bus /sierra_2: Setting Powered False 10:26:32.964819 run create_hlr_db(pid=26330): Terminated: ok {rc=0} 10:26:33.404507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26332): Launched 10:26:33.726288 run osmo-hlr_10.42.42.2(pid=26333): Launched 10:26:33.851372 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:34.411777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26335): Launched 10:26:34.733442 run osmo-stp_10.42.42.5(pid=26336): Launched 10:26:34.858654 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:35.440903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26338): Launched 10:26:35.761226 run osmo-msc_10.42.42.6(pid=26339): Launched 10:26:35.940478 run osmo-stp_10.42.42.5(pid=26336): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26336)] 10:26:36.076055 run osmo-stp_10.42.42.5(pid=26336): stdout: | (launched: 2022-12-09_10:26:34.674303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:36.212191 run osmo-stp_10.42.42.5(pid=26336): stderr: | 20221209102634862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102634862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102634863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102634863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102634864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102634864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102634864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:36.347093 run osmo-stp_10.42.42.5(pid=26336): stdout: | (launched: 2022-12-09_10:26:34.674303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:36.475133 run osmo-stp_10.42.42.5(pid=26336): stderr: | 20221209102634862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102634862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102634863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102634863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102634864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102634864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102634864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:36.628487 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26336): Process ended prematurely: osmo-stp_10.42.42.5(pid=26336) [trial-2358↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26336)] [trial-2358↪ussd:trx-umtrx↪assert_extension.py:17] 10:26:36.637897 tst assert_extension.py:17: Test FAILED (6.1 sec) 10:26:36.666834 run osmo-hlr_10.42.42.2(pid=26333): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26333)] 10:26:36.717943 run osmo-hlr_10.42.42.2(pid=26333): stdout: | (launched: 2022-12-09_10:26:33.667582) 10:26:36.771141 run osmo-hlr_10.42.42.2(pid=26333): stderr: | 20221209102633862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102633862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102633862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102633862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102633862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102633862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102633878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102633889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102633889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102633889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:36.845099 run osmo-msc_10.42.42.6(pid=26339): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26339)] 10:26:36.896263 run osmo-msc_10.42.42.6(pid=26339): stdout: | (launched: 2022-12-09_10:26:35.702873) 10:26:36.949320 run osmo-msc_10.42.42.6(pid=26339): stderr: | 20221209102636020 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102636020 DLGLOBAL DEBUG validating counter group 0x7f8a256b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102636020 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102636020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102636020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102636020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102636022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102636023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102636023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102636023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:37.002806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26332): Terminating (SIGTERM) 10:26:37.045706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26335): Terminating (SIGTERM) 10:26:37.088811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26338): Terminating (SIGTERM) 10:26:37.132428 --- ParallelTerminationStrategy: PID 26332 died... 10:26:37.152804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26332): Terminated: ok {rc=0} 10:26:37.200562 --- ParallelTerminationStrategy: PID 26335 died... 10:26:37.220497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26335): Terminated: ok {rc=0} 10:26:37.267974 --- ParallelTerminationStrategy: PID 26338 died... 10:26:37.287945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26338): Terminated: ok {rc=0} 10:26:37.378204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:26:38.591078 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:38.598448 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:26:38.632909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:26:38.660872 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:26:38.716054 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:26:38.750508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:26:38.778193 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:26:39.326235 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:26:39.380186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:39.391825 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:26:39.462364 tst mo_mt_call.py: using LAC 20823 10:26:39.591167 tst mo_mt_call.py: using RAC 168 10:26:39.718630 tst mo_mt_call.py: using CellId 20823 10:26:39.846409 tst mo_mt_call.py: using BVCI 20824 10:26:39.967530 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:39.978984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:39.990317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:40.002843 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:40.014520 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:40.026383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:26:40.143848 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:26:40.265519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:40.773091 run create_hlr_db(pid=26344): Launched 10:26:40.899078 bus /sierra_2: Setting Powered False 10:26:41.963940 run create_hlr_db(pid=26344): Terminated: ok {rc=0} 10:26:42.419356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26346): Launched 10:26:42.746182 run osmo-hlr_10.42.42.2(pid=26347): Launched 10:26:42.871391 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:43.438139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26349): Launched 10:26:43.768079 run osmo-stp_10.42.42.5(pid=26350): Launched 10:26:43.894904 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:44.489191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26352): Launched 10:26:44.817918 run osmo-msc_10.42.42.6(pid=26353): Launched 10:26:45.002043 run osmo-stp_10.42.42.5(pid=26350): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26350)] 10:26:45.140201 run osmo-stp_10.42.42.5(pid=26350): stdout: | (launched: 2022-12-09_10:26:43.708502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:45.278613 run osmo-stp_10.42.42.5(pid=26350): stderr: | 20221209102643897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102643897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102643897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102643898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102643898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102643898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102643898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:45.415061 run osmo-stp_10.42.42.5(pid=26350): stdout: | (launched: 2022-12-09_10:26:43.708502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:45.545928 run osmo-stp_10.42.42.5(pid=26350): stderr: | 20221209102643897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102643897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102643897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102643898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102643898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102643898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102643898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:45.702296 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26350): Process ended prematurely: osmo-stp_10.42.42.5(pid=26350) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26350)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:26:45.712196 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:26:45.741302 run osmo-hlr_10.42.42.2(pid=26347): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26347)] 10:26:45.792411 run osmo-hlr_10.42.42.2(pid=26347): stdout: | (launched: 2022-12-09_10:26:42.687029) 10:26:45.861415 run osmo-hlr_10.42.42.2(pid=26347): stderr: | 20221209102642881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102642881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102642881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102642881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102642881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102642882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102642893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102642902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102642902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102642902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:45.939308 run osmo-msc_10.42.42.6(pid=26353): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26353)] 10:26:45.991710 run osmo-msc_10.42.42.6(pid=26353): stdout: | (launched: 2022-12-09_10:26:44.758456) 10:26:46.045707 run osmo-msc_10.42.42.6(pid=26353): stderr: | 20221209102645074 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102645075 DLGLOBAL DEBUG validating counter group 0x7fc16d2b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102645075 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102645075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102645075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102645075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102645077 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102645077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102645078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102645078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:46.099784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26346): Terminating (SIGTERM) 10:26:46.143241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26349): Terminating (SIGTERM) 10:26:46.187293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26352): Terminating (SIGTERM) 10:26:46.232537 --- ParallelTerminationStrategy: PID 26346 died... 10:26:46.253046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26346): Terminated: ok {rc=0} 10:26:46.301079 --- ParallelTerminationStrategy: PID 26349 died... 10:26:46.321483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26349): Terminated: ok {rc=0} 10:26:46.369520 --- ParallelTerminationStrategy: PID 26352 died... 10:26:46.389679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26352): Terminated: ok {rc=0} 10:26:46.480029 bus /sierra_3: Setting Powered False 10:26:47.578613 bus /sierra_3: Setting Powered False 10:26:48.693066 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:26:49.845022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:49.857858 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:26:49.929074 tst mo_mt_call_osmux.py: using LAC 20824 10:26:50.058211 tst mo_mt_call_osmux.py: using RAC 169 10:26:50.187833 tst mo_mt_call_osmux.py: using CellId 20824 10:26:50.318830 tst mo_mt_call_osmux.py: using BVCI 20825 10:26:50.437894 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:50.449470 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:50.460768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:50.472507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:50.484646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:26:50.496425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:26:50.617498 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:26:50.734378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:51.239118 run create_hlr_db(pid=26355): Launched 10:26:51.366291 bus /sierra_2: Setting Powered False 10:26:52.430314 run create_hlr_db(pid=26355): Terminated: ok {rc=0} 10:26:52.865089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26357): Launched 10:26:53.168198 run osmo-hlr_10.42.42.2(pid=26358): Launched 10:26:53.283731 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:53.823712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26360): Launched 10:26:54.127213 run osmo-stp_10.42.42.5(pid=26361): Launched 10:26:54.243045 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:54.793451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26363): Launched 10:26:55.099271 run osmo-msc_10.42.42.6(pid=26364): Launched 10:26:55.269692 run osmo-stp_10.42.42.5(pid=26361): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26361)] 10:26:55.398174 run osmo-stp_10.42.42.5(pid=26361): stdout: | (launched: 2022-12-09_10:26:54.071697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:55.526792 run osmo-stp_10.42.42.5(pid=26361): stderr: | 20221209102654239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102654239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102654239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102654239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102654240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102654240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102654240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:55.654071 run osmo-stp_10.42.42.5(pid=26361): stdout: | (launched: 2022-12-09_10:26:54.071697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:55.775119 run osmo-stp_10.42.42.5(pid=26361): stderr: | 20221209102654239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102654239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102654239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102654239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102654240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102654240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102654240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:55.920234 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26361): Process ended prematurely: osmo-stp_10.42.42.5(pid=26361) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26361)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:26:55.929486 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:26:55.956362 run osmo-hlr_10.42.42.2(pid=26358): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26358)] 10:26:56.004533 run osmo-hlr_10.42.42.2(pid=26358): stdout: | (launched: 2022-12-09_10:26:53.112809) 10:26:56.054117 run osmo-hlr_10.42.42.2(pid=26358): stderr: | 20221209102653285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102653285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102653285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102653285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102653285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102653285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102653297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102653305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102653305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102653305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:56.123078 run osmo-msc_10.42.42.6(pid=26364): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26364)] 10:26:56.170764 run osmo-msc_10.42.42.6(pid=26364): stdout: | (launched: 2022-12-09_10:26:55.043242) 10:26:56.219843 run osmo-msc_10.42.42.6(pid=26364): stderr: | 20221209102655312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102655312 DLGLOBAL DEBUG validating counter group 0x7fb87eaa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102655312 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102655312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102655312 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102655313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102655314 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102655315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102655315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102655315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:56.269498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26357): Terminating (SIGTERM) 10:26:56.309422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26360): Terminating (SIGTERM) 10:26:56.349380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26363): Terminating (SIGTERM) 10:26:56.389630 --- ParallelTerminationStrategy: PID 26357 died... 10:26:56.408828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26357): Terminated: ok {rc=0} 10:26:56.453222 --- ParallelTerminationStrategy: PID 26360 died... 10:26:56.472001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26360): Terminated: ok {rc=0} 10:26:56.516244 --- ParallelTerminationStrategy: PID 26363 died... 10:26:56.535079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26363): Terminated: ok {rc=0} 10:26:56.623016 bus /sierra_3: Setting Powered False 10:26:57.723189 bus /sierra_3: Setting Powered False 10:26:58.840141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:27:00.093621 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:00.100649 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:27:00.134711 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:27:00.162050 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:27:00.215763 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:27:00.248325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:27:00.274858 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:27:00.827360 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:27:00.891478 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:00.910233 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:27:00.984307 tst mo_mt_call.py: using LAC 20825 10:27:01.112046 tst mo_mt_call.py: using RAC 170 10:27:01.241490 tst mo_mt_call.py: using CellId 20825 10:27:01.401198 tst mo_mt_call.py: using BVCI 20826 10:27:01.517625 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:01.529587 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:01.541504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:01.553297 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:01.566400 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:01.578337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:27:01.717030 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:27:01.867840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:02.389825 run create_hlr_db(pid=26369): Launched 10:27:02.516655 bus /sierra_2: Setting Powered False 10:27:03.577625 run create_hlr_db(pid=26369): Terminated: ok {rc=0} 10:27:04.001690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26371): Launched 10:27:04.307655 run osmo-hlr_10.42.42.2(pid=26372): Launched 10:27:04.422981 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:04.962047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26374): Launched 10:27:05.271043 run osmo-stp_10.42.42.5(pid=26375): Launched 10:27:05.386996 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:05.938219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26377): Launched 10:27:06.244584 run osmo-msc_10.42.42.6(pid=26378): Launched 10:27:06.415207 run osmo-stp_10.42.42.5(pid=26375): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26375)] 10:27:06.543640 run osmo-stp_10.42.42.5(pid=26375): stdout: | (launched: 2022-12-09_10:27:05.214901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:06.671581 run osmo-stp_10.42.42.5(pid=26375): stderr: | 20221209102705384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102705384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102705384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102705384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102705385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102705385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102705385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:06.798582 run osmo-stp_10.42.42.5(pid=26375): stdout: | (launched: 2022-12-09_10:27:05.214901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:06.920270 run osmo-stp_10.42.42.5(pid=26375): stderr: | 20221209102705384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102705384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102705384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102705384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102705385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102705385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102705385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:07.065815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26375): Process ended prematurely: osmo-stp_10.42.42.5(pid=26375) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26375)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:27:07.074847 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:27:07.101993 run osmo-hlr_10.42.42.2(pid=26372): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26372)] 10:27:07.150610 run osmo-hlr_10.42.42.2(pid=26372): stdout: | (launched: 2022-12-09_10:27:04.252044) 10:27:07.200745 run osmo-hlr_10.42.42.2(pid=26372): stderr: | 20221209102704425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102704425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102704425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102704425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102704425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102704425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102704437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102704446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102704446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102704447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:07.270411 run osmo-msc_10.42.42.6(pid=26378): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26378)] 10:27:07.318767 run osmo-msc_10.42.42.6(pid=26378): stdout: | (launched: 2022-12-09_10:27:06.188735) 10:27:07.368849 run osmo-msc_10.42.42.6(pid=26378): stderr: | 20221209102706459 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102706459 DLGLOBAL DEBUG validating counter group 0x7ffb5da6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102706459 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102706459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102706459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102706459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102706461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102706461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102706462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102706462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:07.419132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26371): Terminating (SIGTERM) 10:27:07.459405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26374): Terminating (SIGTERM) 10:27:07.499622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26377): Terminating (SIGTERM) 10:27:07.540322 --- ParallelTerminationStrategy: PID 26371 died... 10:27:07.559815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26371): Terminated: ok {rc=0} 10:27:07.604806 --- ParallelTerminationStrategy: PID 26374 died... 10:27:07.623948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26374): Terminated: ok {rc=0} 10:27:07.668632 --- ParallelTerminationStrategy: PID 26377 died... 10:27:07.687774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26377): Terminated: ok {rc=0} 10:27:07.775790 bus /sierra_3: Setting Powered False 10:27:08.877874 bus /sierra_3: Setting Powered False 10:27:09.995887 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:27:11.145248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:11.157176 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:27:11.229915 tst mo_mt_call_osmux.py: using LAC 20826 10:27:11.348781 tst mo_mt_call_osmux.py: using RAC 171 10:27:11.466689 tst mo_mt_call_osmux.py: using CellId 20826 10:27:11.585930 tst mo_mt_call_osmux.py: using BVCI 20827 10:27:11.696028 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:11.707151 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:11.718073 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:11.729326 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:11.740414 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:27:11.751409 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:27:11.870475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:27:11.993518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:12.468772 run create_hlr_db(pid=26380): Launched 10:27:12.593718 bus /sierra_2: Setting Powered False 10:27:13.654681 run create_hlr_db(pid=26380): Terminated: ok {rc=0} 10:27:14.080924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26382): Launched 10:27:14.386278 run osmo-hlr_10.42.42.2(pid=26383): Launched 10:27:14.502695 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:15.030345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26385): Launched 10:27:15.335278 run osmo-stp_10.42.42.5(pid=26386): Launched 10:27:15.451614 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:16.007511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26388): Launched 10:27:16.318022 run osmo-msc_10.42.42.6(pid=26389): Launched 10:27:16.703596 run osmo-stp_10.42.42.5(pid=26386): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26386)] 10:27:16.985900 run osmo-stp_10.42.42.5(pid=26386): stdout: | (launched: 2022-12-09_10:27:15.279418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:17.133166 run osmo-stp_10.42.42.5(pid=26386): stderr: | 20221209102715448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102715448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102715448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102715449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102715449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102715449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102715449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:17.262410 run osmo-stp_10.42.42.5(pid=26386): stdout: | (launched: 2022-12-09_10:27:15.279418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:17.383959 run osmo-stp_10.42.42.5(pid=26386): stderr: | 20221209102715448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102715448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102715448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102715449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102715449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102715449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102715449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:17.529914 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26386): Process ended prematurely: osmo-stp_10.42.42.5(pid=26386) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26386)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:27:17.539267 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:27:17.566425 run osmo-hlr_10.42.42.2(pid=26383): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26383)] 10:27:17.614890 run osmo-hlr_10.42.42.2(pid=26383): stdout: | (launched: 2022-12-09_10:27:14.330059) 10:27:17.665155 run osmo-hlr_10.42.42.2(pid=26383): stderr: | 20221209102714503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102714503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102714503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102714503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102714504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102714504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102714516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102714524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102714524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102714524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:17.735130 run osmo-msc_10.42.42.6(pid=26389): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26389)] 10:27:17.783784 run osmo-msc_10.42.42.6(pid=26389): stdout: | (launched: 2022-12-09_10:27:16.261476) 10:27:17.833901 run osmo-msc_10.42.42.6(pid=26389): stderr: | 20221209102716751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102716751 DLGLOBAL DEBUG validating counter group 0x7fba0fc3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102716751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102716751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102716751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102716751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102716757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102716758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102716758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102716758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:17.883910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26382): Terminating (SIGTERM) 10:27:17.924003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26385): Terminating (SIGTERM) 10:27:17.964100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26388): Terminating (SIGTERM) 10:27:18.004470 --- ParallelTerminationStrategy: PID 26382 died... 10:27:18.023861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26382): Terminated: ok {rc=0} 10:27:18.068606 --- ParallelTerminationStrategy: PID 26385 died... 10:27:18.087565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26385): Terminated: ok {rc=0} 10:27:18.131830 --- ParallelTerminationStrategy: PID 26388 died... 10:27:18.150767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26388): Terminated: ok {rc=0} 10:27:18.237523 bus /sierra_3: Setting Powered False 10:27:19.338185 bus /sierra_3: Setting Powered False 10:27:20.453739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:27:21.710192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:21.717800 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:27:21.750500 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:27:21.776682 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:27:21.833799 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:27:21.865843 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:27:21.892115 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:27:22.437595 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:27:22.486341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:22.497421 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:27:22.564177 tst mo_mt_call.py: using LAC 20827 10:27:22.683007 tst mo_mt_call.py: using RAC 172 10:27:22.802601 tst mo_mt_call.py: using CellId 20827 10:27:22.922217 tst mo_mt_call.py: using BVCI 20828 10:27:23.032448 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:23.043474 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:23.054346 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:23.065229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:23.076139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:23.086956 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:27:23.206935 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:27:23.323710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:23.833514 run create_hlr_db(pid=26394): Launched 10:27:23.962970 bus /sierra_2: Setting Powered False 10:27:25.023706 run create_hlr_db(pid=26394): Terminated: ok {rc=0} 10:27:25.481820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26396): Launched 10:27:25.810493 run osmo-hlr_10.42.42.2(pid=26397): Launched 10:27:25.936761 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:26.499926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26399): Launched 10:27:26.828883 run osmo-stp_10.42.42.5(pid=26400): Launched 10:27:26.955265 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:27.549743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26402): Launched 10:27:27.880873 run osmo-msc_10.42.42.6(pid=26403): Launched 10:27:28.065244 run osmo-stp_10.42.42.5(pid=26400): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26400)] 10:27:28.203940 run osmo-stp_10.42.42.5(pid=26400): stdout: | (launched: 2022-12-09_10:27:26.769537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:28.343646 run osmo-stp_10.42.42.5(pid=26400): stderr: | 20221209102726956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102726957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102726957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102726957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102726958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102726958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102726958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:28.481791 run osmo-stp_10.42.42.5(pid=26400): stdout: | (launched: 2022-12-09_10:27:26.769537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:28.613157 run osmo-stp_10.42.42.5(pid=26400): stderr: | 20221209102726956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102726957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102726957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102726957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102726958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102726958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102726958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:28.770357 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26400): Process ended prematurely: osmo-stp_10.42.42.5(pid=26400) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26400)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:27:28.780280 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:27:28.809588 run osmo-hlr_10.42.42.2(pid=26397): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26397)] 10:27:28.860880 run osmo-hlr_10.42.42.2(pid=26397): stdout: | (launched: 2022-12-09_10:27:25.751177) 10:27:28.914452 run osmo-hlr_10.42.42.2(pid=26397): stderr: | 20221209102725945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102725945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102725945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102725945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102725945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102725945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102725957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102725967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102725967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102725967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:28.989208 run osmo-msc_10.42.42.6(pid=26403): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26403)] 10:27:29.041064 run osmo-msc_10.42.42.6(pid=26403): stdout: | (launched: 2022-12-09_10:27:27.820347) 10:27:29.094345 run osmo-msc_10.42.42.6(pid=26403): stderr: | 20221209102728139 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102728139 DLGLOBAL DEBUG validating counter group 0x7f4a3fb3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102728139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102728139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102728139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102728140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102728141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102728142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102728142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102728142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:29.147925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26396): Terminating (SIGTERM) 10:27:29.191090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26399): Terminating (SIGTERM) 10:27:29.234084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26402): Terminating (SIGTERM) 10:27:29.277478 --- ParallelTerminationStrategy: PID 26396 died... 10:27:29.298022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26396): Terminated: ok {rc=0} 10:27:29.346078 --- ParallelTerminationStrategy: PID 26399 died... 10:27:29.366081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26399): Terminated: ok {rc=0} 10:27:29.413482 --- ParallelTerminationStrategy: PID 26402 died... 10:27:29.433440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26402): Terminated: ok {rc=0} 10:27:29.523730 bus /sierra_3: Setting Powered False 10:27:30.621980 bus /sierra_3: Setting Powered False 10:27:31.753394 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:27:32.916046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:32.928533 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:27:32.999968 tst mo_mt_call_osmux.py: using LAC 20828 10:27:33.130560 tst mo_mt_call_osmux.py: using RAC 173 10:27:33.258873 tst mo_mt_call_osmux.py: using CellId 20828 10:27:33.388687 tst mo_mt_call_osmux.py: using BVCI 20829 10:27:33.508025 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:33.519788 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:33.531204 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:33.543036 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:33.555278 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:27:33.567388 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:27:33.685648 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:27:33.806359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:34.317440 run create_hlr_db(pid=26405): Launched 10:27:34.445625 bus /sierra_2: Setting Powered False 10:27:35.510438 run create_hlr_db(pid=26405): Terminated: ok {rc=0} 10:27:35.963726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26410): Launched 10:27:36.294656 run osmo-hlr_10.42.42.2(pid=26411): Launched 10:27:36.420550 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:36.983029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26413): Launched 10:27:37.312352 run osmo-stp_10.42.42.5(pid=26414): Launched 10:27:37.438431 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:38.032052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26416): Launched 10:27:38.359935 run osmo-msc_10.42.42.6(pid=26417): Launched 10:27:38.542331 run osmo-stp_10.42.42.5(pid=26414): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26414)] 10:27:38.679604 run osmo-stp_10.42.42.5(pid=26414): stdout: | (launched: 2022-12-09_10:27:37.252758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:38.816878 run osmo-stp_10.42.42.5(pid=26414): stderr: | 20221209102737441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102737441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102737441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102737441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102737442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102737442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102737442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:38.953943 run osmo-stp_10.42.42.5(pid=26414): stdout: | (launched: 2022-12-09_10:27:37.252758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:39.084725 run osmo-stp_10.42.42.5(pid=26414): stderr: | 20221209102737441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102737441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102737441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102737441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102737442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102737442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102737442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:39.241250 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26414): Process ended prematurely: osmo-stp_10.42.42.5(pid=26414) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26414)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:27:39.251011 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:27:39.280021 run osmo-hlr_10.42.42.2(pid=26411): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26411)] 10:27:39.331280 run osmo-hlr_10.42.42.2(pid=26411): stdout: | (launched: 2022-12-09_10:27:36.235229) 10:27:39.384088 run osmo-hlr_10.42.42.2(pid=26411): stderr: | 20221209102736429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102736429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102736429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102736429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102736429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102736429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102736441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102736450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102736450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102736450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:39.457706 run osmo-msc_10.42.42.6(pid=26417): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26417)] 10:27:39.508802 run osmo-msc_10.42.42.6(pid=26417): stdout: | (launched: 2022-12-09_10:27:38.300163) 10:27:39.561782 run osmo-msc_10.42.42.6(pid=26417): stderr: | 20221209102738620 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102738620 DLGLOBAL DEBUG validating counter group 0x7f794563bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102738620 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102738620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102738620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102738621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102738622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102738623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102738623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102738623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:39.615037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26410): Terminating (SIGTERM) 10:27:39.657724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26413): Terminating (SIGTERM) 10:27:39.700618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26416): Terminating (SIGTERM) 10:27:39.744201 --- ParallelTerminationStrategy: PID 26410 died... 10:27:39.764502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26410): Terminated: ok {rc=0} 10:27:39.811913 --- ParallelTerminationStrategy: PID 26413 died... 10:27:39.831754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26413): Terminated: ok {rc=0} 10:27:39.879295 --- ParallelTerminationStrategy: PID 26416 died... 10:27:39.899060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26416): Terminated: ok {rc=0} 10:27:39.988247 bus /sierra_3: Setting Powered False 10:27:41.088425 bus /sierra_3: Setting Powered False 10:27:42.205721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:27:43.456007 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:43.464617 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:27:43.498766 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:27:43.526060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:27:43.579393 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:27:43.611783 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:27:43.638067 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:27:44.187782 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:27:44.237607 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:44.248793 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:27:44.317036 tst mo_mt_call.py: using LAC 20829 10:27:44.436799 tst mo_mt_call.py: using RAC 174 10:27:44.558138 tst mo_mt_call.py: using CellId 20829 10:27:44.676734 tst mo_mt_call.py: using BVCI 20830 10:27:44.786963 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:44.797972 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:44.808859 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:44.819967 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:44.830830 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:44.842054 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:27:44.961307 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:27:45.080801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:45.554949 run create_hlr_db(pid=26422): Launched 10:27:45.680898 bus /sierra_2: Setting Powered False 10:27:46.754093 run create_hlr_db(pid=26422): Terminated: ok {rc=0} 10:27:47.243407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26424): Launched 10:27:47.578145 run osmo-hlr_10.42.42.2(pid=26425): Launched 10:27:47.705555 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:48.271486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26427): Launched 10:27:48.600117 run osmo-stp_10.42.42.5(pid=26428): Launched 10:27:48.725980 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:49.321919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26430): Launched 10:27:49.652096 run osmo-msc_10.42.42.6(pid=26431): Launched 10:27:49.836441 run osmo-stp_10.42.42.5(pid=26428): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26428)] 10:27:49.975920 run osmo-stp_10.42.42.5(pid=26428): stdout: | (launched: 2022-12-09_10:27:48.540300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:50.115517 run osmo-stp_10.42.42.5(pid=26428): stderr: | 20221209102748728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102748728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102748728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102748729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102748729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102748729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102748729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:50.252603 run osmo-stp_10.42.42.5(pid=26428): stdout: | (launched: 2022-12-09_10:27:48.540300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:50.383685 run osmo-stp_10.42.42.5(pid=26428): stderr: | 20221209102748728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102748728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102748728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102748729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102748729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102748729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102748729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:50.541025 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26428): Process ended prematurely: osmo-stp_10.42.42.5(pid=26428) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26428)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:27:50.550766 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:27:50.579801 run osmo-hlr_10.42.42.2(pid=26425): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26425)] 10:27:50.631333 run osmo-hlr_10.42.42.2(pid=26425): stdout: | (launched: 2022-12-09_10:27:47.519098) 10:27:50.684451 run osmo-hlr_10.42.42.2(pid=26425): stderr: | 20221209102747710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102747710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102747710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102747710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102747710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102747710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102747722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102747730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102747730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102747731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:50.758197 run osmo-msc_10.42.42.6(pid=26431): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26431)] 10:27:50.809891 run osmo-msc_10.42.42.6(pid=26431): stdout: | (launched: 2022-12-09_10:27:49.592071) 10:27:50.863136 run osmo-msc_10.42.42.6(pid=26431): stderr: | 20221209102749912 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102749912 DLGLOBAL DEBUG validating counter group 0x7fe5906dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102749912 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102749912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102749912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102749912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102749914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102749914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102749915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102749915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:50.917695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26424): Terminating (SIGTERM) 10:27:50.960631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26427): Terminating (SIGTERM) 10:27:51.003404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26430): Terminating (SIGTERM) 10:27:51.046848 --- ParallelTerminationStrategy: PID 26424 died... 10:27:51.067640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26424): Terminated: ok {rc=0} 10:27:51.115746 --- ParallelTerminationStrategy: PID 26427 died... 10:27:51.135654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26427): Terminated: ok {rc=0} 10:27:51.183352 --- ParallelTerminationStrategy: PID 26430 died... 10:27:51.203190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26430): Terminated: ok {rc=0} 10:27:51.293170 bus /sierra_3: Setting Powered False 10:27:52.391196 bus /sierra_3: Setting Powered False 10:27:53.508341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:27:54.656057 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:54.667952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:27:54.736525 tst mo_mt_call_osmux.py: using LAC 20830 10:27:54.857757 tst mo_mt_call_osmux.py: using RAC 175 10:27:54.977271 tst mo_mt_call_osmux.py: using CellId 20830 10:27:55.096561 tst mo_mt_call_osmux.py: using BVCI 20831 10:27:55.218110 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:55.229866 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:55.241532 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:55.253499 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:55.265534 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:27:55.277818 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:27:55.396182 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:27:55.512536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:55.985779 run create_hlr_db(pid=26433): Launched 10:27:56.113391 bus /sierra_2: Setting Powered False 10:27:57.174203 run create_hlr_db(pid=26433): Terminated: ok {rc=0} 10:27:57.620784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26435): Launched 10:27:57.948501 run osmo-hlr_10.42.42.2(pid=26436): Launched 10:27:58.074886 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:58.639893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26438): Launched 10:27:58.968495 run osmo-stp_10.42.42.5(pid=26439): Launched 10:27:59.093403 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:59.687436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26441): Launched 10:28:00.014762 run osmo-msc_10.42.42.6(pid=26442): Launched 10:28:00.197502 run osmo-stp_10.42.42.5(pid=26439): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26439)] 10:28:00.335951 run osmo-stp_10.42.42.5(pid=26439): stdout: | (launched: 2022-12-09_10:27:58.908567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:00.474431 run osmo-stp_10.42.42.5(pid=26439): stderr: | 20221209102759096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102759097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102759097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102759097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102759098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102759098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102759098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:00.610829 run osmo-stp_10.42.42.5(pid=26439): stdout: | (launched: 2022-12-09_10:27:58.908567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:00.741082 run osmo-stp_10.42.42.5(pid=26439): stderr: | 20221209102759096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102759097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102759097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102759097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102759098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102759098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102759098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:00.924472 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26439): Process ended prematurely: osmo-stp_10.42.42.5(pid=26439) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26439)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:28:00.935057 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:28:00.965435 run osmo-hlr_10.42.42.2(pid=26436): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26436)] 10:28:01.018066 run osmo-hlr_10.42.42.2(pid=26436): stdout: | (launched: 2022-12-09_10:27:57.888734) 10:28:01.073124 run osmo-hlr_10.42.42.2(pid=26436): stderr: | 20221209102758082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102758082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102758082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102758082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102758082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102758082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102758094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102758103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102758104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102758104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:01.149104 run osmo-msc_10.42.42.6(pid=26442): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26442)] 10:28:01.202279 run osmo-msc_10.42.42.6(pid=26442): stdout: | (launched: 2022-12-09_10:27:59.955046) 10:28:01.257658 run osmo-msc_10.42.42.6(pid=26442): stderr: | 20221209102800273 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102800273 DLGLOBAL DEBUG validating counter group 0x7fb3e24b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102800273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102800273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102800273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102800274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102800275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102800276 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102800276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102800276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:01.313332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26435): Terminating (SIGTERM) 10:28:01.358446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26438): Terminating (SIGTERM) 10:28:01.403130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26441): Terminating (SIGTERM) 10:28:01.448227 --- ParallelTerminationStrategy: PID 26435 died... 10:28:01.469292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26435): Terminated: ok {rc=0} 10:28:01.519308 --- ParallelTerminationStrategy: PID 26438 died... 10:28:01.540046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26438): Terminated: ok {rc=0} 10:28:01.589827 --- ParallelTerminationStrategy: PID 26441 died... 10:28:01.610905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26441): Terminated: ok {rc=0} 10:28:01.704921 bus /sierra_3: Setting Powered False 10:28:02.808259 bus /sierra_3: Setting Powered False 10:28:03.926042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:28:05.178089 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:05.185943 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:28:05.219991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:28:05.247018 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:28:05.297427 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:28:05.329805 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:28:05.356198 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:28:05.911423 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:28:05.961500 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:05.972650 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:28:06.041075 tst mo_mt_call.py: using LAC 20831 10:28:06.159491 tst mo_mt_call.py: using RAC 176 10:28:06.281696 tst mo_mt_call.py: using CellId 20831 10:28:06.400214 tst mo_mt_call.py: using BVCI 20832 10:28:06.510972 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:06.522103 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:06.532915 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:06.544266 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:06.557049 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:06.569444 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:28:06.688251 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:28:06.808368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:07.316344 run create_hlr_db(pid=26447): Launched 10:28:07.442497 bus /sierra_2: Setting Powered False 10:28:08.507411 run create_hlr_db(pid=26447): Terminated: ok {rc=0} 10:28:08.943678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26449): Launched 10:28:09.248539 run osmo-hlr_10.42.42.2(pid=26450): Launched 10:28:09.365486 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:09.891822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26452): Launched 10:28:10.197754 run osmo-stp_10.42.42.5(pid=26453): Launched 10:28:10.315736 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:10.872006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26455): Launched 10:28:11.177819 run osmo-msc_10.42.42.6(pid=26456): Launched 10:28:11.350909 run osmo-stp_10.42.42.5(pid=26453): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26453)] 10:28:11.480477 run osmo-stp_10.42.42.5(pid=26453): stdout: | (launched: 2022-12-09_10:28:10.141505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:11.609950 run osmo-stp_10.42.42.5(pid=26453): stderr: | 20221209102810308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102810309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102810309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102810309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102810310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102810310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102810310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:11.738143 run osmo-stp_10.42.42.5(pid=26453): stdout: | (launched: 2022-12-09_10:28:10.141505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:11.860330 run osmo-stp_10.42.42.5(pid=26453): stderr: | 20221209102810308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102810309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102810309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102810309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102810310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102810310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102810310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:12.006860 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26453): Process ended prematurely: osmo-stp_10.42.42.5(pid=26453) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26453)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:28:12.016060 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:28:12.043001 run osmo-hlr_10.42.42.2(pid=26450): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26450)] 10:28:12.091078 run osmo-hlr_10.42.42.2(pid=26450): stdout: | (launched: 2022-12-09_10:28:09.192794) 10:28:12.141132 run osmo-hlr_10.42.42.2(pid=26450): stderr: | 20221209102809367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102809367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102809367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102809367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102809367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102809367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102809379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102809389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102809389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102809389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:12.210763 run osmo-msc_10.42.42.6(pid=26456): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26456)] 10:28:12.258979 run osmo-msc_10.42.42.6(pid=26456): stdout: | (launched: 2022-12-09_10:28:11.121926) 10:28:12.308430 run osmo-msc_10.42.42.6(pid=26456): stderr: | 20221209102811390 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102811390 DLGLOBAL DEBUG validating counter group 0x7fad00b03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102811390 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102811390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102811391 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102811391 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102811392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102811393 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102811393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102811393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:12.358260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26449): Terminating (SIGTERM) 10:28:12.398169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26452): Terminating (SIGTERM) 10:28:12.438098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26455): Terminating (SIGTERM) 10:28:12.478216 --- ParallelTerminationStrategy: PID 26449 died... 10:28:12.497529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26449): Terminated: ok {rc=0} 10:28:12.541981 --- ParallelTerminationStrategy: PID 26452 died... 10:28:12.560919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26452): Terminated: ok {rc=0} 10:28:12.605187 --- ParallelTerminationStrategy: PID 26455 died... 10:28:12.623925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26455): Terminated: ok {rc=0} 10:28:12.708127 bus /sierra_3: Setting Powered False 10:28:13.807934 bus /sierra_3: Setting Powered False 10:28:14.926310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:28:16.095125 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:16.111909 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:28:16.190688 tst mo_mt_call_osmux.py: using LAC 20832 10:28:16.321369 tst mo_mt_call_osmux.py: using RAC 177 10:28:16.446845 tst mo_mt_call_osmux.py: using CellId 20832 10:28:16.573661 tst mo_mt_call_osmux.py: using BVCI 20833 10:28:16.687106 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:16.698688 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:16.710088 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:16.721674 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:16.733150 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:28:16.744668 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:28:16.869951 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:28:16.993994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:17.489320 run create_hlr_db(pid=26458): Launched 10:28:17.615343 bus /sierra_2: Setting Powered False 10:28:18.676242 run create_hlr_db(pid=26458): Terminated: ok {rc=0} 10:28:19.123744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26461): Launched 10:28:19.453139 run osmo-hlr_10.42.42.2(pid=26462): Launched 10:28:19.581036 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:20.143917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26464): Launched 10:28:20.472202 run osmo-stp_10.42.42.5(pid=26465): Launched 10:28:20.598139 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:21.191639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26467): Launched 10:28:21.522928 run osmo-msc_10.42.42.6(pid=26468): Launched 10:28:21.709631 run osmo-stp_10.42.42.5(pid=26465): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26465)] 10:28:21.849131 run osmo-stp_10.42.42.5(pid=26465): stdout: | (launched: 2022-12-09_10:28:20.412723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:21.990162 run osmo-stp_10.42.42.5(pid=26465): stderr: | 20221209102820601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102820601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102820601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102820602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102820602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102820602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102820602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:22.127838 run osmo-stp_10.42.42.5(pid=26465): stdout: | (launched: 2022-12-09_10:28:20.412723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:22.259647 run osmo-stp_10.42.42.5(pid=26465): stderr: | 20221209102820601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102820601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102820601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102820602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102820602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102820602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102820602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:22.417277 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26465): Process ended prematurely: osmo-stp_10.42.42.5(pid=26465) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26465)] [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:28:22.427264 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:28:22.456760 run osmo-hlr_10.42.42.2(pid=26462): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26462)] 10:28:22.507867 run osmo-hlr_10.42.42.2(pid=26462): stdout: | (launched: 2022-12-09_10:28:19.393638) 10:28:22.560895 run osmo-hlr_10.42.42.2(pid=26462): stderr: | 20221209102819588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102819588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102819588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102819588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102819588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102819588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102819601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102819610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102819610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102819610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:22.634405 run osmo-msc_10.42.42.6(pid=26468): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26468)] 10:28:22.685419 run osmo-msc_10.42.42.6(pid=26468): stdout: | (launched: 2022-12-09_10:28:21.462222) 10:28:22.738123 run osmo-msc_10.42.42.6(pid=26468): stderr: | 20221209102821780 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102821780 DLGLOBAL DEBUG validating counter group 0x7fa19f7b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102821780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102821780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102821781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102821781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102821783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102821783 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102821783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102821783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:22.791013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26461): Terminating (SIGTERM) 10:28:22.833544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26464): Terminating (SIGTERM) 10:28:22.876090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26467): Terminating (SIGTERM) 10:28:22.919565 --- ParallelTerminationStrategy: PID 26461 died... 10:28:22.939924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26461): Terminated: ok {rc=0} 10:28:22.987350 --- ParallelTerminationStrategy: PID 26464 died... 10:28:23.007185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26464): Terminated: ok {rc=0} 10:28:23.054458 --- ParallelTerminationStrategy: PID 26467 died... 10:28:23.074326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26467): Terminated: ok {rc=0} 10:28:23.163846 bus /sierra_3: Setting Powered False 10:28:24.265536 bus /sierra_3: Setting Powered False 10:28:25.385251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:28:26.639603 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:26.646177 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:28:26.678222 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:28:26.704501 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:28:26.755748 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:28:26.787463 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:28:26.813635 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:28:27.366178 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:28:27.414823 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:27.425983 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:28:27.498201 tst mo_mt_call.py: using LAC 20833 10:28:27.618576 tst mo_mt_call.py: using RAC 178 10:28:27.738492 tst mo_mt_call.py: using CellId 20833 10:28:27.868488 tst mo_mt_call.py: using BVCI 20834 10:28:27.980510 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:27.991663 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:28.002922 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:28.013893 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:28.024867 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:28.035757 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:28:28.155100 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:28:28.271345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:28.747824 run create_hlr_db(pid=26473): Launched 10:28:28.873396 bus /sierra_2: Setting Powered False 10:28:29.934468 run create_hlr_db(pid=26473): Terminated: ok {rc=0} 10:28:30.361636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26475): Launched 10:28:30.669524 run osmo-hlr_10.42.42.2(pid=26476): Launched 10:28:30.787074 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:31.453765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26478): Launched 10:28:31.772164 run osmo-stp_10.42.42.5(pid=26479): Launched 10:28:31.986405 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:32.634856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26481): Launched 10:28:32.965070 run osmo-msc_10.42.42.6(pid=26482): Launched 10:28:33.149707 run osmo-stp_10.42.42.5(pid=26479): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26479)] 10:28:33.288169 run osmo-stp_10.42.42.5(pid=26479): stdout: | (launched: 2022-12-09_10:28:31.714434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:33.427366 run osmo-stp_10.42.42.5(pid=26479): stderr: | 20221209102832066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102832066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102832066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102832066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102832067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102832077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102832077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:33.564925 run osmo-stp_10.42.42.5(pid=26479): stdout: | (launched: 2022-12-09_10:28:31.714434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:33.696178 run osmo-stp_10.42.42.5(pid=26479): stderr: | 20221209102832066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102832066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102832066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102832066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102832067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102832077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102832077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:33.853261 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26479): Process ended prematurely: osmo-stp_10.42.42.5(pid=26479) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26479)] [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:28:33.863152 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:28:33.892363 run osmo-hlr_10.42.42.2(pid=26476): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26476)] 10:28:33.943390 run osmo-hlr_10.42.42.2(pid=26476): stdout: | (launched: 2022-12-09_10:28:30.613253) 10:28:33.995981 run osmo-hlr_10.42.42.2(pid=26476): stderr: | 20221209102830788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102830788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102830789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102830789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102830789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102830789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102830801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102830809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102830809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102830810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:34.068862 run osmo-msc_10.42.42.6(pid=26482): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26482)] 10:28:34.119570 run osmo-msc_10.42.42.6(pid=26482): stdout: | (launched: 2022-12-09_10:28:32.905198) 10:28:34.172092 run osmo-msc_10.42.42.6(pid=26482): stderr: | 20221209102833225 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102833225 DLGLOBAL DEBUG validating counter group 0x7f1ff6148c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102833225 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102833225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102833226 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102833226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102833227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102833228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102833228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102833228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:34.225223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26475): Terminating (SIGTERM) 10:28:34.267760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26478): Terminating (SIGTERM) 10:28:34.310317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26481): Terminating (SIGTERM) 10:28:34.353390 --- ParallelTerminationStrategy: PID 26475 died... 10:28:34.373650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26475): Terminated: ok {rc=0} 10:28:34.421361 --- ParallelTerminationStrategy: PID 26478 died... 10:28:34.441116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26478): Terminated: ok {rc=0} 10:28:34.488242 --- ParallelTerminationStrategy: PID 26481 died... 10:28:34.508175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26481): Terminated: ok {rc=0} 10:28:34.598261 bus /sierra_3: Setting Powered False 10:28:35.698100 bus /sierra_3: Setting Powered False 10:28:36.815067 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:28:37.966459 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:37.979100 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:28:38.053859 tst mo_mt_call_osmux.py: using LAC 20834 10:28:38.182614 tst mo_mt_call_osmux.py: using RAC 179 10:28:38.314527 tst mo_mt_call_osmux.py: using CellId 20834 10:28:38.444171 tst mo_mt_call_osmux.py: using BVCI 20835 10:28:38.565271 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:38.576885 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:38.588425 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:38.600277 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:38.612779 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:28:38.625141 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:28:38.746046 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:28:38.868305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:39.377816 run create_hlr_db(pid=26484): Launched 10:28:39.504550 bus /sierra_2: Setting Powered False 10:28:40.569659 run create_hlr_db(pid=26484): Terminated: ok {rc=0} 10:28:41.006088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26486): Launched 10:28:41.314811 run osmo-hlr_10.42.42.2(pid=26487): Launched 10:28:41.431279 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:41.959265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26489): Launched 10:28:42.264372 run osmo-stp_10.42.42.5(pid=26490): Launched 10:28:42.382310 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:42.939334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26492): Launched 10:28:43.245767 run osmo-msc_10.42.42.6(pid=26493): Launched 10:28:43.417253 run osmo-stp_10.42.42.5(pid=26490): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26490)] 10:28:43.545922 run osmo-stp_10.42.42.5(pid=26490): stdout: | (launched: 2022-12-09_10:28:42.208520) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:43.674286 run osmo-stp_10.42.42.5(pid=26490): stderr: | 20221209102842375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102842375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102842376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102842376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102842377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102842377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102842377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:43.801461 run osmo-stp_10.42.42.5(pid=26490): stdout: | (launched: 2022-12-09_10:28:42.208520) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:43.922849 run osmo-stp_10.42.42.5(pid=26490): stderr: | 20221209102842375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102842375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102842376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102842376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102842377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102842377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102842377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:44.068771 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26490): Process ended prematurely: osmo-stp_10.42.42.5(pid=26490) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26490)] [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:28:44.077950 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:28:44.104570 run osmo-hlr_10.42.42.2(pid=26487): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26487)] 10:28:44.152408 run osmo-hlr_10.42.42.2(pid=26487): stdout: | (launched: 2022-12-09_10:28:41.258828) 10:28:44.202192 run osmo-hlr_10.42.42.2(pid=26487): stderr: | 20221209102841433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102841433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102841433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102841433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102841433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102841434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102841446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102841454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102841454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102841454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:44.271763 run osmo-msc_10.42.42.6(pid=26493): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26493)] 10:28:44.319689 run osmo-msc_10.42.42.6(pid=26493): stdout: | (launched: 2022-12-09_10:28:43.189732) 10:28:44.369605 run osmo-msc_10.42.42.6(pid=26493): stderr: | 20221209102843459 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102843460 DLGLOBAL DEBUG validating counter group 0x7f79dc3b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102843460 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102843460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102843460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102843460 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102843462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102843462 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102843463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102843463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:44.419655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26486): Terminating (SIGTERM) 10:28:44.460281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26489): Terminating (SIGTERM) 10:28:44.500581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26492): Terminating (SIGTERM) 10:28:44.540802 --- ParallelTerminationStrategy: PID 26486 died... 10:28:44.560086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26486): Terminated: ok {rc=0} 10:28:44.604414 --- ParallelTerminationStrategy: PID 26489 died... 10:28:44.623000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26489): Terminated: ok {rc=0} 10:28:44.667089 --- ParallelTerminationStrategy: PID 26492 died... 10:28:44.685761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26492): Terminated: ok {rc=0} 10:28:44.769553 bus /sierra_3: Setting Powered False 10:28:45.875329 bus /sierra_3: Setting Powered False 10:28:47.016779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:28:48.266909 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:48.272414 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:28:48.304659 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:28:48.331006 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:28:48.383131 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:28:48.415541 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:28:48.441878 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:28:48.989359 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:28:49.038200 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:49.049099 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:28:49.117508 tst mo_mt_call.py: using LAC 20835 10:28:49.247449 tst mo_mt_call.py: using RAC 180 10:28:49.377371 tst mo_mt_call.py: using CellId 20835 10:28:49.504372 tst mo_mt_call.py: using BVCI 20836 10:28:49.623386 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:49.634824 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:49.646120 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:49.657840 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:49.669326 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:49.680697 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:28:49.801149 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:28:49.919251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:50.429119 run create_hlr_db(pid=26498): Launched 10:28:50.555200 bus /sierra_2: Setting Powered False 10:28:51.616646 run create_hlr_db(pid=26498): Terminated: ok {rc=0} 10:28:52.053986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Launched 10:28:52.360466 run osmo-hlr_10.42.42.2(pid=26501): Launched 10:28:52.477299 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:53.020503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Launched 10:28:53.325728 run osmo-stp_10.42.42.5(pid=26504): Launched 10:28:53.442355 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:53.995103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26506): Launched 10:28:54.301821 run osmo-msc_10.42.42.6(pid=26507): Launched 10:28:54.474150 run osmo-stp_10.42.42.5(pid=26504): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] 10:28:54.604574 run osmo-stp_10.42.42.5(pid=26504): stdout: | (launched: 2022-12-09_10:28:53.269884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:54.733795 run osmo-stp_10.42.42.5(pid=26504): stderr: | 20221209102853437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102853438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102853438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102853438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102853439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102853439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102853439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:54.861375 run osmo-stp_10.42.42.5(pid=26504): stdout: | (launched: 2022-12-09_10:28:53.269884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:54.983986 run osmo-stp_10.42.42.5(pid=26504): stderr: | 20221209102853437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102853438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102853438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102853438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102853439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102853439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102853439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:55.130568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26504): Process ended prematurely: osmo-stp_10.42.42.5(pid=26504) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:28:55.139526 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:28:55.166211 run osmo-hlr_10.42.42.2(pid=26501): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26501)] 10:28:55.214228 run osmo-hlr_10.42.42.2(pid=26501): stdout: | (launched: 2022-12-09_10:28:52.304411) 10:28:55.263954 run osmo-hlr_10.42.42.2(pid=26501): stderr: | 20221209102852478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102852478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102852478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102852478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102852478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102852478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102852491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102852499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102852499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102852499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:55.333569 run osmo-msc_10.42.42.6(pid=26507): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26507)] 10:28:55.381915 run osmo-msc_10.42.42.6(pid=26507): stdout: | (launched: 2022-12-09_10:28:54.245915) 10:28:55.431799 run osmo-msc_10.42.42.6(pid=26507): stderr: | 20221209102854516 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102854516 DLGLOBAL DEBUG validating counter group 0x7f8dc1483c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102854516 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102854516 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102854516 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102854516 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102854518 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102854519 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102854519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102854519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:55.483238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Terminating (SIGTERM) 10:28:55.523565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Terminating (SIGTERM) 10:28:55.563742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26506): Terminating (SIGTERM) 10:28:55.604398 --- ParallelTerminationStrategy: PID 26500 died... 10:28:55.623868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26500): Terminated: ok {rc=0} 10:28:55.668409 --- ParallelTerminationStrategy: PID 26503 died... 10:28:55.687167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26503): Terminated: ok {rc=0} 10:28:55.731570 --- ParallelTerminationStrategy: PID 26506 died... 10:28:55.750542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26506): Terminated: ok {rc=0} 10:28:55.837642 bus /sierra_3: Setting Powered False 10:28:56.938630 bus /sierra_3: Setting Powered False 10:28:58.055613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:28:59.203637 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:59.215213 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:28:59.286514 tst mo_mt_call_osmux.py: using LAC 20836 10:28:59.408543 tst mo_mt_call_osmux.py: using RAC 181 10:28:59.530679 tst mo_mt_call_osmux.py: using CellId 20836 10:28:59.652404 tst mo_mt_call_osmux.py: using BVCI 20837 10:28:59.765439 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:59.776587 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:59.787375 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:59.798639 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:59.809890 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:28:59.821348 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:28:59.937250 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:29:00.058263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:00.570022 run create_hlr_db(pid=26509): Launched 10:29:00.697624 bus /sierra_2: Setting Powered False 10:29:01.762929 run create_hlr_db(pid=26509): Terminated: ok {rc=0} 10:29:02.241409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Launched 10:29:02.546950 run osmo-hlr_10.42.42.2(pid=26514): Launched 10:29:02.664281 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:03.206328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Launched 10:29:03.511487 run osmo-stp_10.42.42.5(pid=26517): Launched 10:29:03.627950 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:04.185767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26519): Launched 10:29:04.494174 run osmo-msc_10.42.42.6(pid=26520): Launched 10:29:04.667874 run osmo-stp_10.42.42.5(pid=26517): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] 10:29:04.796700 run osmo-stp_10.42.42.5(pid=26517): stdout: | (launched: 2022-12-09_10:29:03.455535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:04.925527 run osmo-stp_10.42.42.5(pid=26517): stderr: | 20221209102903624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102903624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102903624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102903625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102903626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102903626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102903626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:05.052554 run osmo-stp_10.42.42.5(pid=26517): stdout: | (launched: 2022-12-09_10:29:03.455535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:05.174397 run osmo-stp_10.42.42.5(pid=26517): stderr: | 20221209102903624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102903624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102903624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102903625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102903626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102903626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102903626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:05.320323 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26517): Process ended prematurely: osmo-stp_10.42.42.5(pid=26517) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:29:05.329410 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:29:05.356304 run osmo-hlr_10.42.42.2(pid=26514): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26514)] 10:29:05.404690 run osmo-hlr_10.42.42.2(pid=26514): stdout: | (launched: 2022-12-09_10:29:02.491339) 10:29:05.454390 run osmo-hlr_10.42.42.2(pid=26514): stderr: | 20221209102902665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102902666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102902666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102902666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102902666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102902666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102902678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102902686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102902687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102902687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:05.523865 run osmo-msc_10.42.42.6(pid=26520): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26520)] 10:29:05.571948 run osmo-msc_10.42.42.6(pid=26520): stdout: | (launched: 2022-12-09_10:29:04.437803) 10:29:05.621822 run osmo-msc_10.42.42.6(pid=26520): stderr: | 20221209102904709 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102904709 DLGLOBAL DEBUG validating counter group 0x7fd385923c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102904709 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102904709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102904709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102904709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102904711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102904711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102904712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102904712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:05.671958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Terminating (SIGTERM) 10:29:05.712508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Terminating (SIGTERM) 10:29:05.752524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26519): Terminating (SIGTERM) 10:29:05.792836 --- ParallelTerminationStrategy: PID 26513 died... 10:29:05.812237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Terminated: ok {rc=0} 10:29:05.857051 --- ParallelTerminationStrategy: PID 26516 died... 10:29:05.875842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Terminated: ok {rc=0} 10:29:05.920068 --- ParallelTerminationStrategy: PID 26519 died... 10:29:05.938915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26519): Terminated: ok {rc=0} 10:29:06.023746 bus /sierra_3: Setting Powered False 10:29:07.123484 bus /sierra_3: Setting Powered False 10:29:08.241968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:29:09.488775 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:09.495183 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:29:09.527165 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:29:09.553447 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:29:09.606839 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:29:09.639302 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:29:09.665466 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:29:10.216536 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:29:10.265666 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:10.276857 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:29:10.328310 tst mo_mt_call.py: using LAC 20837 10:29:10.449190 tst mo_mt_call.py: using RAC 182 10:29:10.568350 tst mo_mt_call.py: using CellId 20837 10:29:10.698426 tst mo_mt_call.py: using BVCI 20838 10:29:10.820011 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:10.832187 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:10.844026 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:10.855993 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:10.867824 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:10.879608 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:29:10.996655 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:29:11.114422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:11.591383 run create_hlr_db(pid=26525): Launched 10:29:11.718005 bus /sierra_2: Setting Powered False 10:29:12.779353 run create_hlr_db(pid=26525): Terminated: ok {rc=0} 10:29:13.227172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26527): Launched 10:29:13.558097 run osmo-hlr_10.42.42.2(pid=26528): Launched 10:29:13.686604 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:14.253387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26530): Launched 10:29:14.582715 run osmo-stp_10.42.42.5(pid=26531): Launched 10:29:14.708578 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:15.302838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26533): Launched 10:29:15.633643 run osmo-msc_10.42.42.6(pid=26534): Launched 10:29:15.819804 run osmo-stp_10.42.42.5(pid=26531): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26531)] 10:29:16.019460 run osmo-stp_10.42.42.5(pid=26531): stdout: | (launched: 2022-12-09_10:29:14.523007) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:16.271741 run osmo-stp_10.42.42.5(pid=26531): stderr: | 20221209102914711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102914711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102914711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102914712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102914713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102914713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102914713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:16.421477 run osmo-stp_10.42.42.5(pid=26531): stdout: | (launched: 2022-12-09_10:29:14.523007) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:16.557453 run osmo-stp_10.42.42.5(pid=26531): stderr: | 20221209102914711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102914711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102914711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102914712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102914713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102914713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102914713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:16.720493 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26531): Process ended prematurely: osmo-stp_10.42.42.5(pid=26531) [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26531)] [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:29:16.731267 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:29:16.763493 run osmo-hlr_10.42.42.2(pid=26528): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26528)] 10:29:16.817691 run osmo-hlr_10.42.42.2(pid=26528): stdout: | (launched: 2022-12-09_10:29:13.498319) 10:29:16.872668 run osmo-hlr_10.42.42.2(pid=26528): stderr: | 20221209102913693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102913693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102913693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102913693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102913693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102913693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102913705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102913714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102913715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102913715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:16.949055 run osmo-msc_10.42.42.6(pid=26534): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26534)] 10:29:17.002091 run osmo-msc_10.42.42.6(pid=26534): stdout: | (launched: 2022-12-09_10:29:15.573758) 10:29:17.057060 run osmo-msc_10.42.42.6(pid=26534): stderr: | 20221209102915995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102915995 DLGLOBAL DEBUG validating counter group 0x7fe2818c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102915995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102915995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102915995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102915996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102916003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102916003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102916003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102916003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:17.112382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26527): Terminating (SIGTERM) 10:29:17.157157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26530): Terminating (SIGTERM) 10:29:17.201855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26533): Terminating (SIGTERM) 10:29:17.246944 --- ParallelTerminationStrategy: PID 26527 died... 10:29:17.267081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26527): Terminated: ok {rc=0} 10:29:17.315564 --- ParallelTerminationStrategy: PID 26530 died... 10:29:17.335245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26530): Terminated: ok {rc=0} 10:29:17.383099 --- ParallelTerminationStrategy: PID 26533 died... 10:29:17.402742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26533): Terminated: ok {rc=0} 10:29:17.493601 bus /sierra_3: Setting Powered False 10:29:18.595042 bus /sierra_3: Setting Powered False 10:29:19.712175 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:29:20.861851 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:20.874386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:29:20.931745 tst mo_mt_call_osmux.py: using LAC 20838 10:29:21.060465 tst mo_mt_call_osmux.py: using RAC 183 10:29:21.187918 tst mo_mt_call_osmux.py: using CellId 20838 10:29:21.317318 tst mo_mt_call_osmux.py: using BVCI 20839 10:29:21.436864 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:21.448696 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:21.460433 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:21.472438 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:21.484296 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:29:21.496096 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:29:21.615067 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:29:21.735730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:22.246485 run create_hlr_db(pid=26536): Launched 10:29:22.374414 bus /sierra_2: Setting Powered False 10:29:23.438951 run create_hlr_db(pid=26536): Terminated: ok {rc=0} 10:29:23.875318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26538): Launched 10:29:24.182044 run osmo-hlr_10.42.42.2(pid=26539): Launched 10:29:24.302711 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:24.834249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26541): Launched 10:29:25.139278 run osmo-stp_10.42.42.5(pid=26542): Launched 10:29:25.255526 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:25.808909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26544): Launched 10:29:26.114122 run osmo-msc_10.42.42.6(pid=26545): Launched 10:29:26.288154 run osmo-stp_10.42.42.5(pid=26542): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26542)] 10:29:26.417225 run osmo-stp_10.42.42.5(pid=26542): stdout: | (launched: 2022-12-09_10:29:25.083551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:26.545985 run osmo-stp_10.42.42.5(pid=26542): stderr: | 20221209102925251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102925251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102925252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102925252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102925253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102925253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102925253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:26.672788 run osmo-stp_10.42.42.5(pid=26542): stdout: | (launched: 2022-12-09_10:29:25.083551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:26.795591 run osmo-stp_10.42.42.5(pid=26542): stderr: | 20221209102925251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102925251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102925252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102925252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102925253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102925253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102925253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:26.942249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26542): Process ended prematurely: osmo-stp_10.42.42.5(pid=26542) [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26542)] [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:29:26.951426 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:29:26.978022 run osmo-hlr_10.42.42.2(pid=26539): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26539)] 10:29:27.026774 run osmo-hlr_10.42.42.2(pid=26539): stdout: | (launched: 2022-12-09_10:29:24.125945) 10:29:27.076737 run osmo-hlr_10.42.42.2(pid=26539): stderr: | 20221209102924299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102924299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102924299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102924299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102924299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102924299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102924311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102924319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102924320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102924320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:27.146341 run osmo-msc_10.42.42.6(pid=26545): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26545)] 10:29:27.194154 run osmo-msc_10.42.42.6(pid=26545): stdout: | (launched: 2022-12-09_10:29:26.057871) 10:29:27.243773 run osmo-msc_10.42.42.6(pid=26545): stderr: | 20221209102926327 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102926327 DLGLOBAL DEBUG validating counter group 0x7f3db2f68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102926327 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102926327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102926328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102926328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102926330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102926330 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102926330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102926330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:27.293853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26538): Terminating (SIGTERM) 10:29:27.333858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26541): Terminating (SIGTERM) 10:29:27.373740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26544): Terminating (SIGTERM) 10:29:27.413894 --- ParallelTerminationStrategy: PID 26538 died... 10:29:27.433225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26538): Terminated: ok {rc=0} 10:29:27.477627 --- ParallelTerminationStrategy: PID 26541 died... 10:29:27.496591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26541): Terminated: ok {rc=0} 10:29:27.540571 --- ParallelTerminationStrategy: PID 26544 died... 10:29:27.559373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26544): Terminated: ok {rc=0} 10:29:27.643983 bus /sierra_3: Setting Powered False 10:29:28.740452 bus /sierra_3: Setting Powered False 10:29:29.854441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:trx-umtrx --------------------------------------------------------------------- 10:29:31.123993 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:31.131674 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:29:31.181096 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:29:31.218637 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:29:31.326643 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:29:31.361213 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:29:31.390289 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:29:31.969432 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 10:29:31.975652 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:31.987761 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:29:32.043261 tst emergency_mo_mt_call.py: using LAC 20839 10:29:32.190711 tst emergency_mo_mt_call.py: using RAC 184 10:29:32.323869 tst emergency_mo_mt_call.py: using CellId 20839 10:29:32.443923 tst emergency_mo_mt_call.py: using BVCI 20840 10:29:32.553890 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:32.564938 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:32.575676 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:32.586342 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:32.596889 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:32.607252 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:32.722281 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:32.845213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:33.347550 run create_hlr_db(pid=26550): Launched 10:29:33.472172 bus /sierra_2: Setting Powered False 10:29:34.535383 run create_hlr_db(pid=26550): Terminated: ok {rc=0} 10:29:34.968047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26552): Launched 10:29:35.269269 run osmo-hlr_10.42.42.2(pid=26553): Launched 10:29:35.384565 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:35.902996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26555): Launched 10:29:36.204602 run osmo-stp_10.42.42.5(pid=26556): Launched 10:29:36.329174 tst emergency_mo_mt_call.py: using MSISDN 7160 10:29:36.494198 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:37.041524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26558): Launched 10:29:37.346229 run osmo-msc_10.42.42.6(pid=26559): Launched 10:29:37.516929 run osmo-stp_10.42.42.5(pid=26556): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26556)] 10:29:37.644416 run osmo-stp_10.42.42.5(pid=26556): stdout: | (launched: 2022-12-09_10:29:36.149118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:37.772816 run osmo-stp_10.42.42.5(pid=26556): stderr: | 20221209102936315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102936315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102936315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102936315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102936316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102936316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102936316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:37.899054 run osmo-stp_10.42.42.5(pid=26556): stdout: | (launched: 2022-12-09_10:29:36.149118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:38.019492 run osmo-stp_10.42.42.5(pid=26556): stderr: | 20221209102936315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102936315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102936315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102936315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102936316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102936316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102936316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:38.163326 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26556): Process ended prematurely: osmo-stp_10.42.42.5(pid=26556) [trial-2358↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26556)] [trial-2358↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 10:29:38.171864 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:29:38.198482 run osmo-hlr_10.42.42.2(pid=26553): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26553)] 10:29:38.246993 run osmo-hlr_10.42.42.2(pid=26553): stdout: | (launched: 2022-12-09_10:29:35.213906) 10:29:38.297220 run osmo-hlr_10.42.42.2(pid=26553): stderr: | 20221209102935388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102935388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102935388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102935388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102935388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102935389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102935401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102935410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102935410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102935410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:38.367109 run osmo-msc_10.42.42.6(pid=26559): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26559)] 10:29:38.415568 run osmo-msc_10.42.42.6(pid=26559): stdout: | (launched: 2022-12-09_10:29:37.290094) 10:29:38.465650 run osmo-msc_10.42.42.6(pid=26559): stderr: | 20221209102937561 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102937561 DLGLOBAL DEBUG validating counter group 0x7fe6ddf9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102937562 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102937562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102937562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102937562 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102937564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102937564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102937564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102937564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:38.516126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26552): Terminating (SIGTERM) 10:29:38.556399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26555): Terminating (SIGTERM) 10:29:38.596644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26558): Terminating (SIGTERM) 10:29:38.637777 --- ParallelTerminationStrategy: PID 26552 died... 10:29:38.657277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26552): Terminated: ok {rc=0} 10:29:38.702014 --- ParallelTerminationStrategy: PID 26555 died... 10:29:38.721177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26555): Terminated: ok {rc=0} 10:29:38.765858 --- ParallelTerminationStrategy: PID 26558 died... 10:29:38.784663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26558): Terminated: ok {rc=0} 10:29:38.869988 bus /sierra_3: Setting Powered False 10:29:39.971320 bus /sierra_3: Setting Powered False 10:29:41.088852 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 10:29:42.177617 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:42.189924 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:29:42.245410 tst emergency_preemptive_call.py: using LAC 20840 10:29:42.371039 tst emergency_preemptive_call.py: using RAC 185 10:29:42.496727 tst emergency_preemptive_call.py: using CellId 20840 10:29:42.626364 tst emergency_preemptive_call.py: using BVCI 20841 10:29:42.745858 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:42.757091 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:42.768158 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:42.779710 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:42.791117 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:29:42.802402 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:42.922077 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:43.039729 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:43.157408 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:43.273898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:43.778761 run create_hlr_db(pid=26561): Launched 10:29:43.903831 bus /sierra_2: Setting Powered False 10:29:44.969419 run create_hlr_db(pid=26561): Terminated: ok {rc=0} 10:29:45.422001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26563): Launched 10:29:45.745989 run osmo-hlr_10.42.42.2(pid=26564): Launched 10:29:45.871248 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:46.549637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26566): Launched 10:29:46.875057 run osmo-stp_10.42.42.5(pid=26567): Launched 10:29:47.115691 tst emergency_preemptive_call.py: using MSISDN 7161 10:29:47.367602 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:47.913205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26569): Launched 10:29:48.214758 run osmo-msc_10.42.42.6(pid=26570): Launched 10:29:48.383902 run osmo-stp_10.42.42.5(pid=26567): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26567)] 10:29:48.510969 run osmo-stp_10.42.42.5(pid=26567): stdout: | (launched: 2022-12-09_10:29:46.818346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:48.637699 run osmo-stp_10.42.42.5(pid=26567): stderr: | 20221209102947124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102947124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102947124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102947125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102947125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102947126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102947126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:48.763405 run osmo-stp_10.42.42.5(pid=26567): stdout: | (launched: 2022-12-09_10:29:46.818346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:48.883038 run osmo-stp_10.42.42.5(pid=26567): stderr: | 20221209102947124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209102947124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209102947124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209102947125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209102947125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209102947126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209102947126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:49.026940 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26567): Process ended prematurely: osmo-stp_10.42.42.5(pid=26567) [trial-2358↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26567)] [trial-2358↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 10:29:49.035546 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 10:29:49.062229 run osmo-hlr_10.42.42.2(pid=26564): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26564)] 10:29:49.110735 run osmo-hlr_10.42.42.2(pid=26564): stdout: | (launched: 2022-12-09_10:29:45.686479) 10:29:49.161055 run osmo-hlr_10.42.42.2(pid=26564): stderr: | 20221209102945961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209102945961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209102945961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209102945961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209102945961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209102945961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209102945979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209102945994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209102945994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209102945994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:49.230982 run osmo-msc_10.42.42.6(pid=26570): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26570)] 10:29:49.279207 run osmo-msc_10.42.42.6(pid=26570): stdout: | (launched: 2022-12-09_10:29:48.159334) 10:29:49.329664 run osmo-msc_10.42.42.6(pid=26570): stderr: | 20221209102948428 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209102948428 DLGLOBAL DEBUG validating counter group 0x7f9543db1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209102948428 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209102948428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209102948428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209102948428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209102948430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209102948431 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209102948431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209102948431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:49.380037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26563): Terminating (SIGTERM) 10:29:49.420282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26566): Terminating (SIGTERM) 10:29:49.460503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26569): Terminating (SIGTERM) 10:29:49.501101 --- ParallelTerminationStrategy: PID 26563 died... 10:29:49.520581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26563): Terminated: ok {rc=0} 10:29:49.565314 --- ParallelTerminationStrategy: PID 26566 died... 10:29:49.584393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26566): Terminated: ok {rc=0} 10:29:49.629228 --- ParallelTerminationStrategy: PID 26569 died... 10:29:49.647877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26569): Terminated: ok {rc=0} 10:29:49.732801 bus /sierra_9: Setting Powered False 10:29:50.832100 bus /sierra_9: Setting Powered False 10:29:51.952694 bus /sierra_8: Setting Powered False 10:29:53.052811 bus /sierra_8: Setting Powered False 10:29:54.170363 bus /sierra_3: Setting Powered False 10:29:55.270219 bus /sierra_3: Setting Powered False 10:29:56.386599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx --------------------------------------------------------------------- 10:29:57.669406 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:57.674087 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:29:57.708082 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 10:29:57.747629 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:29:57.836283 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:29:57.869833 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 10:29:57.909554 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:29:58.498968 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 10:29:58.553697 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:58.564577 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:29:58.614207 tst cs_paging_gprs_active.py: using LAC 20841 10:29:58.744019 tst cs_paging_gprs_active.py: using RAC 186 10:29:58.877299 tst cs_paging_gprs_active.py: using CellId 20841 10:29:59.005598 tst cs_paging_gprs_active.py: using BVCI 20842 10:29:59.126118 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.137260 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.148023 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.159297 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.170485 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.181540 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.192761 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.203763 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:29:59.215082 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:59.332320 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:29:59.453633 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:29:59.678206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:00.009438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Launched 10:30:00.296795 run iperf3-srv_10.42.42.10(pid=26576): Launched 10:30:00.421337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:30:00.643422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:00.977771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26577): Launched 10:30:01.269812 run iperf3-srv_10.42.42.10(pid=26578): Launched 10:30:01.405155 tst cs_paging_gprs_active.py:38: start network... 10:30:01.644649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:02.173482 run create_hlr_db(pid=26582): Launched 10:30:02.329690 bus /sierra_2: Setting Powered False 10:30:03.396019 run create_hlr_db(pid=26582): Terminated: ok {rc=0} 10:30:03.854953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26584): Launched 10:30:04.188281 run osmo-hlr_10.42.42.2(pid=26585): Launched 10:30:04.314817 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:04.886581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26587): Launched 10:30:05.218395 run osmo-stp_10.42.42.5(pid=26588): Launched 10:30:05.344359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:05.912292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26590): Launched 10:30:06.040681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:06.318612 run patchelf(pid=26591): Launched 10:30:06.503436 run osmo-stp_10.42.42.5(pid=26588): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26588)] 10:30:06.642903 run osmo-stp_10.42.42.5(pid=26588): stdout: | (launched: 2022-12-09_10:30:05.157858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:06.783840 run osmo-stp_10.42.42.5(pid=26588): stderr: | 20221209103005346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103005346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103005347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103005347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103005347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103005348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103005348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:06.924546 run osmo-stp_10.42.42.5(pid=26588): stdout: | (launched: 2022-12-09_10:30:05.157858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:07.060087 run osmo-stp_10.42.42.5(pid=26588): stderr: | 20221209103005346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103005346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103005347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103005347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103005347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103005348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103005348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:07.220495 run patchelf(pid=26591): Terminating (SIGINT) 10:30:07.404433 run patchelf(pid=26591): Terminated: ok {rc=0} 10:30:07.537368 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26588): Process ended prematurely: osmo-stp_10.42.42.5(pid=26588) [trial-2358↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26588)] [trial-2358↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 10:30:07.547665 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:30:07.577374 run osmo-hlr_10.42.42.2(pid=26585): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26585)] 10:30:07.628535 run osmo-hlr_10.42.42.2(pid=26585): stdout: | (launched: 2022-12-09_10:30:04.127806) 10:30:07.681466 run osmo-hlr_10.42.42.2(pid=26585): stderr: | 20221209103004323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103004323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103004323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103004324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103004324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103004324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103004336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103004345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103004345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103004345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:07.734576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminating (SIGTERM) 10:30:07.777204 run iperf3-srv_10.42.42.10(pid=26576): Terminating (SIGTERM) 10:30:07.819893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26577): Terminating (SIGTERM) 10:30:07.862664 run iperf3-srv_10.42.42.10(pid=26578): Terminating (SIGTERM) 10:30:07.905087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26584): Terminating (SIGTERM) 10:30:07.947798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26587): Terminating (SIGTERM) 10:30:07.990795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26590): Terminating (SIGTERM) 10:30:08.033971 --- ParallelTerminationStrategy: PID 26575 died... 10:30:08.054247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminated: ok {rc=0} 10:30:08.101663 --- ParallelTerminationStrategy: PID 26576 died... 10:30:08.121455 run iperf3-srv_10.42.42.10(pid=26576): Terminated {rc=256} 10:30:08.168412 --- ParallelTerminationStrategy: PID 26577 died... 10:30:08.188207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26577): Terminated: ok {rc=0} 10:30:08.235451 --- ParallelTerminationStrategy: PID 26578 died... 10:30:08.255153 run iperf3-srv_10.42.42.10(pid=26578): Terminated {rc=256} 10:30:08.302118 --- ParallelTerminationStrategy: PID 26584 died... 10:30:08.321876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26584): Terminated: ok {rc=0} 10:30:08.369608 --- ParallelTerminationStrategy: PID 26587 died... 10:30:08.389547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26587): Terminated: ok {rc=0} 10:30:08.436703 --- ParallelTerminationStrategy: PID 26590 died... 10:30:08.456545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26590): Terminated: ok {rc=0} 10:30:08.545280 bus /gobi_0: Setting Powered False 10:30:09.645602 bus /gobi_0: Setting Powered False 10:30:10.761838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx iperf3.py ---------------------------------------------- 10:30:11.911768 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:11.923456 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:30:11.975982 tst iperf3.py: using LAC 20842 10:30:12.105506 tst iperf3.py: using RAC 187 10:30:12.226815 tst iperf3.py: using CellId 20842 10:30:12.353481 tst iperf3.py: using BVCI 20843 10:30:12.466586 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.477419 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.487831 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.498437 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.508618 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.519138 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.529898 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.540159 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:12.550789 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:12.667921 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:30:12.891667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:13.224537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26592): Launched 10:30:13.512440 run iperf3-srv_10.42.42.10(pid=26593): Launched 10:30:13.637521 tst iperf3.py:8: start network... 10:30:13.859754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:14.371728 run create_hlr_db(pid=26594): Launched 10:30:14.498813 bus /gobi_6: Setting Powered False 10:30:15.563314 run create_hlr_db(pid=26594): Terminated: ok {rc=0} 10:30:16.039628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26596): Launched 10:30:16.408328 run osmo-hlr_10.42.42.2(pid=26597): Launched 10:30:16.575303 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:17.315782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26599): Launched 10:30:17.646016 run osmo-stp_10.42.42.5(pid=26600): Launched 10:30:17.772422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:18.338998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26602): Launched 10:30:18.466848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:18.745741 run patchelf(pid=26603): Launched 10:30:18.929814 run osmo-stp_10.42.42.5(pid=26600): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26600)] 10:30:19.070718 run osmo-stp_10.42.42.5(pid=26600): stdout: | (launched: 2022-12-09_10:30:17.586060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:19.212586 run osmo-stp_10.42.42.5(pid=26600): stderr: | 20221209103017776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103017776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103017777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103017777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103017777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103017778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103017778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:19.355096 run osmo-stp_10.42.42.5(pid=26600): stdout: | (launched: 2022-12-09_10:30:17.586060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:19.487842 run osmo-stp_10.42.42.5(pid=26600): stderr: | 20221209103017776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103017776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103017777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103017777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103017777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103017778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103017778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:19.638021 run patchelf(pid=26603): Terminating (SIGINT) 10:30:19.809712 run patchelf(pid=26603): Terminated: ok {rc=0} 10:30:19.933573 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26600): Process ended prematurely: osmo-stp_10.42.42.5(pid=26600) [trial-2358↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26600)] [trial-2358↪gprs:trx-umtrx↪iperf3.py:8] 10:30:19.943224 tst iperf3.py:8: Test FAILED (8.1 sec) 10:30:19.970913 run osmo-hlr_10.42.42.2(pid=26597): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26597)] 10:30:20.018797 run osmo-hlr_10.42.42.2(pid=26597): stdout: | (launched: 2022-12-09_10:30:16.347061) 10:30:20.068315 run osmo-hlr_10.42.42.2(pid=26597): stderr: | 20221209103016708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103016708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103016708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103016721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103016721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103016721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103016760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103016776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103016776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103016776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:20.118315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26592): Terminating (SIGTERM) 10:30:20.158228 run iperf3-srv_10.42.42.10(pid=26593): Terminating (SIGTERM) 10:30:20.197872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26596): Terminating (SIGTERM) 10:30:20.238402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26599): Terminating (SIGTERM) 10:30:20.278517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26602): Terminating (SIGTERM) 10:30:20.319193 --- ParallelTerminationStrategy: PID 26592 died... 10:30:20.338689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26592): Terminated: ok {rc=0} 10:30:20.383323 --- ParallelTerminationStrategy: PID 26593 died... 10:30:20.402188 run iperf3-srv_10.42.42.10(pid=26593): Terminated {rc=256} 10:30:20.446453 --- ParallelTerminationStrategy: PID 26596 died... 10:30:20.465408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26596): Terminated: ok {rc=0} 10:30:20.509607 --- ParallelTerminationStrategy: PID 26599 died... 10:30:20.528530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26599): Terminated: ok {rc=0} 10:30:20.573041 --- ParallelTerminationStrategy: PID 26602 died... 10:30:20.592063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26602): Terminated: ok {rc=0} 10:30:20.677338 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 10:30:21.829906 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:21.841535 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:30:21.892615 tst iperf3m4.py: using LAC 20843 10:30:22.024600 tst iperf3m4.py: using RAC 188 10:30:22.156032 tst iperf3m4.py: using CellId 20843 10:30:22.290386 tst iperf3m4.py: using BVCI 20844 10:30:22.412027 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.423177 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.434134 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.445711 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.457226 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.468595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.480339 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.491871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:22.504319 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:22.625427 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:22.749952 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:22.870065 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:22.986967 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:30:23.193180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:23.502222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26604): Launched 10:30:23.770273 run iperf3-srv_10.42.42.10(pid=26605): Launched 10:30:23.887889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:30:24.093761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:24.401821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26606): Launched 10:30:24.670604 run iperf3-srv_10.42.42.10(pid=26607): Launched 10:30:24.786423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:30:24.991003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:25.299173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26608): Launched 10:30:25.567172 run iperf3-srv_10.42.42.10(pid=26609): Launched 10:30:25.682516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:30:25.886981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:26.194543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26610): Launched 10:30:26.463770 run iperf3-srv_10.42.42.10(pid=26611): Launched 10:30:26.578947 tst iperf3m4.py:8: start network... 10:30:26.782677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:27.259077 run create_hlr_db(pid=26612): Launched 10:30:27.388073 bus /gobi_6: Setting Powered False 10:30:28.450099 run create_hlr_db(pid=26612): Terminated: ok {rc=0} 10:30:28.899472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26614): Launched 10:30:29.229990 run osmo-hlr_10.42.42.2(pid=26615): Launched 10:30:29.356449 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:29.923948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26617): Launched 10:30:30.254636 run osmo-stp_10.42.42.5(pid=26618): Launched 10:30:30.382426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:30.957932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26620): Launched 10:30:31.102316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:31.368399 run patchelf(pid=26621): Launched 10:30:31.553468 run osmo-stp_10.42.42.5(pid=26618): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26618)] 10:30:31.688037 run osmo-stp_10.42.42.5(pid=26618): stdout: | (launched: 2022-12-09_10:30:30.194861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:31.824138 run osmo-stp_10.42.42.5(pid=26618): stderr: | 20221209103030384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103030384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103030384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103030385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103030385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103030385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103030385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:31.959652 run osmo-stp_10.42.42.5(pid=26618): stdout: | (launched: 2022-12-09_10:30:30.194861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:32.091249 run osmo-stp_10.42.42.5(pid=26618): stderr: | 20221209103030384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103030384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103030384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103030385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103030385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103030385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103030385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:32.245173 run patchelf(pid=26621): Terminating (SIGINT) 10:30:32.418555 run patchelf(pid=26621): Terminated: ok {rc=0} 10:30:32.542435 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26618): Process ended prematurely: osmo-stp_10.42.42.5(pid=26618) [trial-2358↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26618)] [trial-2358↪gprs:trx-umtrx↪iperf3m4.py:8] 10:30:32.552153 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:30:32.580301 run osmo-hlr_10.42.42.2(pid=26615): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26615)] 10:30:32.628142 run osmo-hlr_10.42.42.2(pid=26615): stdout: | (launched: 2022-12-09_10:30:29.170087) 10:30:32.678538 run osmo-hlr_10.42.42.2(pid=26615): stderr: | 20221209103029364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103029364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103029364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103029364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103029364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103029364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103029377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103029386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103029386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103029386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:32.728408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26604): Terminating (SIGTERM) 10:30:32.769982 run iperf3-srv_10.42.42.10(pid=26605): Terminating (SIGTERM) 10:30:32.810272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26606): Terminating (SIGTERM) 10:30:32.850169 run iperf3-srv_10.42.42.10(pid=26607): Terminating (SIGTERM) 10:30:32.890004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26608): Terminating (SIGTERM) 10:30:32.930012 run iperf3-srv_10.42.42.10(pid=26609): Terminating (SIGTERM) 10:30:32.969773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26610): Terminating (SIGTERM) 10:30:33.010525 run iperf3-srv_10.42.42.10(pid=26611): Terminating (SIGTERM) 10:30:33.050287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26614): Terminating (SIGTERM) 10:30:33.090348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26617): Terminating (SIGTERM) 10:30:33.130371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26620): Terminating (SIGTERM) 10:30:33.170630 --- ParallelTerminationStrategy: PID 26604 died... 10:30:33.189645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26604): Terminated: ok {rc=0} 10:30:33.233936 --- ParallelTerminationStrategy: PID 26605 died... 10:30:33.252780 run iperf3-srv_10.42.42.10(pid=26605): Terminated {rc=256} 10:30:33.297582 --- ParallelTerminationStrategy: PID 26606 died... 10:30:33.316570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26606): Terminated: ok {rc=0} 10:30:33.361906 --- ParallelTerminationStrategy: PID 26607 died... 10:30:33.380899 run iperf3-srv_10.42.42.10(pid=26607): Terminated {rc=256} 10:30:33.425545 --- ParallelTerminationStrategy: PID 26608 died... 10:30:33.444491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26608): Terminated: ok {rc=0} 10:30:33.489334 --- ParallelTerminationStrategy: PID 26609 died... 10:30:33.508374 run iperf3-srv_10.42.42.10(pid=26609): Terminated {rc=256} 10:30:33.553336 --- ParallelTerminationStrategy: PID 26610 died... 10:30:33.572486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26610): Terminated: ok {rc=0} 10:30:33.617392 --- ParallelTerminationStrategy: PID 26611 died... 10:30:33.636370 run iperf3-srv_10.42.42.10(pid=26611): Terminated {rc=256} 10:30:33.681093 --- ParallelTerminationStrategy: PID 26614 died... 10:30:33.700071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26614): Terminated: ok {rc=0} 10:30:33.744829 --- ParallelTerminationStrategy: PID 26617 died... 10:30:33.764311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26617): Terminated: ok {rc=0} 10:30:33.808773 --- ParallelTerminationStrategy: PID 26620 died... 10:30:33.827842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26620): Terminated: ok {rc=0} 10:30:33.915057 bus /gobi_4: Setting Powered False 10:30:35.018661 bus /gobi_4: Setting Powered False 10:30:36.133060 bus /gobi_1: Setting Powered False 10:30:37.229184 bus /gobi_1: Setting Powered False 10:30:38.344915 bus /gobi_0: Setting Powered False 10:30:39.443979 bus /gobi_0: Setting Powered False 10:30:40.561184 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx ping.py ---------------------------------------------- 10:30:41.664212 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:41.676296 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:30:41.727795 tst ping.py: using LAC 20844 10:30:41.858308 tst ping.py: using RAC 189 10:30:41.986375 tst ping.py: using CellId 20844 10:30:42.114339 tst ping.py: using BVCI 20845 10:30:42.234721 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.245797 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.256619 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.268191 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.279717 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.291200 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.303281 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:42.315366 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:42.434220 tst ping.py:19: start network... 10:30:42.633841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:43.100548 run create_hlr_db(pid=26622): Launched 10:30:43.225075 bus /gobi_6: Setting Powered False 10:30:44.288658 run create_hlr_db(pid=26622): Terminated: ok {rc=0} 10:30:44.739470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26624): Launched 10:30:45.064906 run osmo-hlr_10.42.42.2(pid=26625): Launched 10:30:45.188762 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:45.753795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26627): Launched 10:30:46.075491 run osmo-stp_10.42.42.5(pid=26628): Launched 10:30:46.195079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:46.918710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26630): Launched 10:30:47.051128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:47.312552 run patchelf(pid=26631): Launched 10:30:47.496230 run osmo-stp_10.42.42.5(pid=26628): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26628)] 10:30:47.634149 run osmo-stp_10.42.42.5(pid=26628): stdout: | (launched: 2022-12-09_10:30:46.017090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:47.773076 run osmo-stp_10.42.42.5(pid=26628): stderr: | 20221209103046341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103046341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103046341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103046342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103046342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103046342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103046342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:47.911976 run osmo-stp_10.42.42.5(pid=26628): stdout: | (launched: 2022-12-09_10:30:46.017090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:48.046050 run osmo-stp_10.42.42.5(pid=26628): stderr: | 20221209103046341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103046341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103046341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103046342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103046342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103046342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103046342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:48.204226 run patchelf(pid=26631): Terminating (SIGINT) 10:30:48.385934 run patchelf(pid=26631): Terminated: ok {rc=0} 10:30:48.517137 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26628): Process ended prematurely: osmo-stp_10.42.42.5(pid=26628) [trial-2358↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26628)] [trial-2358↪gprs:trx-umtrx↪ping.py:22] 10:30:48.526849 tst ping.py:22: Test FAILED (6.9 sec) 10:30:48.556152 run osmo-hlr_10.42.42.2(pid=26625): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26625)] 10:30:48.607545 run osmo-hlr_10.42.42.2(pid=26625): stdout: | (launched: 2022-12-09_10:30:45.005979) 10:30:48.660697 run osmo-hlr_10.42.42.2(pid=26625): stderr: | 20221209103045202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103045202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103045202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103045202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103045202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103045202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103045215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103045223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103045223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103045223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:48.714391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26624): Terminating (SIGTERM) 10:30:48.757473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26627): Terminating (SIGTERM) 10:30:48.800696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26630): Terminating (SIGTERM) 10:30:48.844747 --- ParallelTerminationStrategy: PID 26624 died... 10:30:48.865235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26624): Terminated: ok {rc=0} 10:30:48.912909 --- ParallelTerminationStrategy: PID 26627 died... 10:30:48.933104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26627): Terminated: ok {rc=0} 10:30:48.981357 --- ParallelTerminationStrategy: PID 26630 died... 10:30:49.001452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26630): Terminated: ok {rc=0} 10:30:49.091755 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 10:30:50.180532 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.192466 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:30:50.247542 tst ping_idle_ping.py: using LAC 20845 10:30:50.373750 tst ping_idle_ping.py: using RAC 190 10:30:50.492853 tst ping_idle_ping.py: using CellId 20845 10:30:50.621301 tst ping_idle_ping.py: using BVCI 20846 10:30:50.739507 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.750873 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.762134 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.773573 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.784858 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.796175 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.807370 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:30:50.818577 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:30:50.938473 tst ping_idle_ping.py:24: start network... 10:30:51.157751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:51.662804 run create_hlr_db(pid=26632): Launched 10:30:51.787003 bus /gobi_6: Setting Powered False 10:30:52.851343 run create_hlr_db(pid=26632): Terminated: ok {rc=0} 10:30:53.284793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26634): Launched 10:30:53.589074 run osmo-hlr_10.42.42.2(pid=26635): Launched 10:30:53.704337 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:54.228819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26637): Launched 10:30:54.531549 run osmo-stp_10.42.42.5(pid=26638): Launched 10:30:54.647660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:55.168790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26640): Launched 10:30:55.284808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:55.541295 run patchelf(pid=26641): Launched 10:30:55.710639 run osmo-stp_10.42.42.5(pid=26638): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26638)] 10:30:55.838971 run osmo-stp_10.42.42.5(pid=26638): stdout: | (launched: 2022-12-09_10:30:54.475857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:55.968524 run osmo-stp_10.42.42.5(pid=26638): stderr: | 20221209103054642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103054642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103054642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103054643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103054643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103054643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103054643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:56.098274 run osmo-stp_10.42.42.5(pid=26638): stdout: | (launched: 2022-12-09_10:30:54.475857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:56.222832 run osmo-stp_10.42.42.5(pid=26638): stderr: | 20221209103054642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103054642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103054642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103054643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103054643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103054643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103054643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:56.370284 run patchelf(pid=26641): Terminating (SIGINT) 10:30:56.539485 run patchelf(pid=26641): Terminated: ok {rc=0} 10:30:56.661683 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26638): Process ended prematurely: osmo-stp_10.42.42.5(pid=26638) [trial-2358↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26638)] [trial-2358↪gprs:trx-umtrx↪ping_idle_ping.py:27] 10:30:56.671125 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:30:56.698677 run osmo-hlr_10.42.42.2(pid=26635): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26635)] 10:30:56.747616 run osmo-hlr_10.42.42.2(pid=26635): stdout: | (launched: 2022-12-09_10:30:53.533291) 10:30:56.798184 run osmo-hlr_10.42.42.2(pid=26635): stderr: | 20221209103053705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103053705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103053705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103053705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103053705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103053705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103053718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103053727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103053728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103053728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:56.849285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26634): Terminating (SIGTERM) 10:30:56.889867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26637): Terminating (SIGTERM) 10:30:56.930447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26640): Terminating (SIGTERM) 10:30:56.971373 --- ParallelTerminationStrategy: PID 26634 died... 10:30:56.990645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26634): Terminated: ok {rc=0} 10:30:57.035457 --- ParallelTerminationStrategy: PID 26637 died... 10:30:57.054420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26637): Terminated: ok {rc=0} 10:30:57.099429 --- ParallelTerminationStrategy: PID 26640 died... 10:30:57.118593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26640): Terminated: ok {rc=0} 10:30:57.206852 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 10:30:58.509016 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:30:58.514778 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:30:58.547484 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:30:58.585692 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:30:58.671522 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:30:58.703705 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:30:58.741791 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:30:59.333822 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:30:59.383596 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:30:59.394701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:30:59.445117 tst cs_paging_gprs_active.py: using LAC 20846 10:30:59.568618 tst cs_paging_gprs_active.py: using RAC 191 10:30:59.689559 tst cs_paging_gprs_active.py: using CellId 20846 10:30:59.821345 tst cs_paging_gprs_active.py: using BVCI 20847 10:30:59.943294 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:30:59.954639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:30:59.965786 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:30:59.977642 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:30:59.989706 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:00.001434 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:00.014267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:00.025267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:00.037674 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:00.157374 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:00.278244 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:31:00.486215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:00.794537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26645): Launched 10:31:01.067739 run iperf3-srv_10.42.42.10(pid=26646): Launched 10:31:01.199091 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:31:01.414535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:01.765507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26647): Launched 10:31:02.049961 run iperf3-srv_10.42.42.10(pid=26648): Launched 10:31:02.183460 tst cs_paging_gprs_active.py:38: start network... 10:31:02.390487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:02.868431 run create_hlr_db(pid=26649): Launched 10:31:02.996170 bus /gobi_6: Setting Powered False 10:31:04.058286 run create_hlr_db(pid=26649): Terminated: ok {rc=0} 10:31:04.509130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26651): Launched 10:31:04.840421 run osmo-hlr_10.42.42.2(pid=26652): Launched 10:31:04.968169 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:05.536187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26654): Launched 10:31:05.868058 run osmo-stp_10.42.42.5(pid=26655): Launched 10:31:05.995839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:06.566259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26657): Launched 10:31:06.694863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:06.974400 run patchelf(pid=26658): Launched 10:31:07.159432 run osmo-stp_10.42.42.5(pid=26655): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26655)] 10:31:07.299533 run osmo-stp_10.42.42.5(pid=26655): stdout: | (launched: 2022-12-09_10:31:05.807740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:07.440532 run osmo-stp_10.42.42.5(pid=26655): stderr: | 20221209103105998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103105998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103105998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103105999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103105999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103105999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103105999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:07.581380 run osmo-stp_10.42.42.5(pid=26655): stdout: | (launched: 2022-12-09_10:31:05.807740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:07.717820 run osmo-stp_10.42.42.5(pid=26655): stderr: | 20221209103105998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103105998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103105998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103105999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103105999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103105999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103105999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:07.878789 run patchelf(pid=26658): Terminating (SIGINT) 10:31:08.064750 run patchelf(pid=26658): Terminated: ok {rc=0} 10:31:08.198524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26655): Process ended prematurely: osmo-stp_10.42.42.5(pid=26655) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26655)] [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:31:08.208720 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:31:08.238441 run osmo-hlr_10.42.42.2(pid=26652): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26652)] 10:31:08.289524 run osmo-hlr_10.42.42.2(pid=26652): stdout: | (launched: 2022-12-09_10:31:04.780073) 10:31:08.342466 run osmo-hlr_10.42.42.2(pid=26652): stderr: | 20221209103104976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103104976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103104976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103104976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103104976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103104976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103104988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103104998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103104998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103104998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:08.395779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26645): Terminating (SIGTERM) 10:31:08.438205 run iperf3-srv_10.42.42.10(pid=26646): Terminating (SIGTERM) 10:31:08.480544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26647): Terminating (SIGTERM) 10:31:08.522778 run iperf3-srv_10.42.42.10(pid=26648): Terminating (SIGTERM) 10:31:08.565125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26651): Terminating (SIGTERM) 10:31:08.608390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26654): Terminating (SIGTERM) 10:31:08.650752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26657): Terminating (SIGTERM) 10:31:08.693497 --- ParallelTerminationStrategy: PID 26645 died... 10:31:08.713713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26645): Terminated: ok {rc=0} 10:31:08.760695 --- ParallelTerminationStrategy: PID 26646 died... 10:31:08.780389 run iperf3-srv_10.42.42.10(pid=26646): Terminated {rc=256} 10:31:08.827161 --- ParallelTerminationStrategy: PID 26647 died... 10:31:08.846901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26647): Terminated: ok {rc=0} 10:31:08.893598 --- ParallelTerminationStrategy: PID 26648 died... 10:31:08.913167 run iperf3-srv_10.42.42.10(pid=26648): Terminated {rc=256} 10:31:08.959839 --- ParallelTerminationStrategy: PID 26651 died... 10:31:08.979586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26651): Terminated: ok {rc=0} 10:31:09.026591 --- ParallelTerminationStrategy: PID 26654 died... 10:31:09.046333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26654): Terminated: ok {rc=0} 10:31:09.093183 --- ParallelTerminationStrategy: PID 26657 died... 10:31:09.112920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26657): Terminated: ok {rc=0} 10:31:09.201917 bus /gobi_0: Setting Powered False 10:31:10.303981 bus /gobi_0: Setting Powered False 10:31:11.420239 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:31:12.572031 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:12.585416 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:31:12.643696 tst iperf3.py: using LAC 20847 10:31:12.774791 tst iperf3.py: using RAC 192 10:31:12.906031 tst iperf3.py: using CellId 20847 10:31:13.038181 tst iperf3.py: using BVCI 20848 10:31:13.159224 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.170631 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.181767 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.193812 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.205854 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.217488 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.229388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.241352 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:13.253223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:13.374122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:31:13.597114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:13.928259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26659): Launched 10:31:14.216118 run iperf3-srv_10.42.42.10(pid=26660): Launched 10:31:14.339958 tst iperf3.py:8: start network... 10:31:14.562974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:15.073974 run create_hlr_db(pid=26661): Launched 10:31:15.201188 bus /gobi_6: Setting Powered False 10:31:16.283620 run create_hlr_db(pid=26661): Terminated: ok {rc=0} 10:31:16.730760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26663): Launched 10:31:17.088602 run osmo-hlr_10.42.42.2(pid=26664): Launched 10:31:17.273738 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:17.846422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26666): Launched 10:31:18.177699 run osmo-stp_10.42.42.5(pid=26667): Launched 10:31:18.303703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:18.874476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26669): Launched 10:31:19.000315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:19.278078 run patchelf(pid=26670): Launched 10:31:19.460823 run osmo-stp_10.42.42.5(pid=26667): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26667)] 10:31:19.599352 run osmo-stp_10.42.42.5(pid=26667): stdout: | (launched: 2022-12-09_10:31:18.117738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:19.739885 run osmo-stp_10.42.42.5(pid=26667): stderr: | 20221209103118306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103118306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103118307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103118307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103118307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103118308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103118308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:19.880083 run osmo-stp_10.42.42.5(pid=26667): stdout: | (launched: 2022-12-09_10:31:18.117738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:20.015148 run osmo-stp_10.42.42.5(pid=26667): stderr: | 20221209103118306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103118306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103118307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103118307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103118307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103118308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103118308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:20.174743 run patchelf(pid=26670): Terminating (SIGINT) 10:31:20.358646 run patchelf(pid=26670): Terminated: ok {rc=0} 10:31:20.490953 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26667): Process ended prematurely: osmo-stp_10.42.42.5(pid=26667) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26667)] [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 10:31:20.501475 tst iperf3.py:8: Test FAILED (8.0 sec) 10:31:20.531158 run osmo-hlr_10.42.42.2(pid=26664): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26664)] 10:31:20.582242 run osmo-hlr_10.42.42.2(pid=26664): stdout: | (launched: 2022-12-09_10:31:17.021710) 10:31:20.634738 run osmo-hlr_10.42.42.2(pid=26664): stderr: | 20221209103117277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103117277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103117277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103117277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103117277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103117277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103117291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103117302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103117302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103117302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:20.687949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26659): Terminating (SIGTERM) 10:31:20.730349 run iperf3-srv_10.42.42.10(pid=26660): Terminating (SIGTERM) 10:31:20.772650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26663): Terminating (SIGTERM) 10:31:20.815404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26666): Terminating (SIGTERM) 10:31:20.857719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26669): Terminating (SIGTERM) 10:31:20.900224 --- ParallelTerminationStrategy: PID 26659 died... 10:31:20.920395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26659): Terminated: ok {rc=0} 10:31:20.967044 --- ParallelTerminationStrategy: PID 26660 died... 10:31:20.986928 run iperf3-srv_10.42.42.10(pid=26660): Terminated {rc=256} 10:31:21.033430 --- ParallelTerminationStrategy: PID 26663 died... 10:31:21.053180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26663): Terminated: ok {rc=0} 10:31:21.099923 --- ParallelTerminationStrategy: PID 26666 died... 10:31:21.119533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26666): Terminated: ok {rc=0} 10:31:21.166191 --- ParallelTerminationStrategy: PID 26669 died... 10:31:21.185793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26669): Terminated: ok {rc=0} 10:31:21.274661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:31:22.427479 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:22.439725 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:31:22.490396 tst iperf3m4.py: using LAC 20848 10:31:22.620510 tst iperf3m4.py: using RAC 193 10:31:22.752065 tst iperf3m4.py: using CellId 20848 10:31:22.878786 tst iperf3m4.py: using BVCI 20849 10:31:23.000811 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.012267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.023345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.034750 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.046194 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.057415 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.068733 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.079936 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:23.091422 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:23.212592 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:23.330928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:23.451378 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:23.568329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:31:23.776639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:24.086134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26671): Launched 10:31:24.357399 run iperf3-srv_10.42.42.10(pid=26672): Launched 10:31:24.473917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:31:24.679676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:24.988457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26673): Launched 10:31:25.255093 run iperf3-srv_10.42.42.10(pid=26674): Launched 10:31:25.370414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:31:25.574841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:25.882958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26675): Launched 10:31:26.150457 run iperf3-srv_10.42.42.10(pid=26676): Launched 10:31:26.267718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:31:26.472756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:26.780795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26677): Launched 10:31:27.049089 run iperf3-srv_10.42.42.10(pid=26678): Launched 10:31:27.164154 tst iperf3m4.py:8: start network... 10:31:27.368487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:27.845547 run create_hlr_db(pid=26679): Launched 10:31:27.973255 bus /gobi_6: Setting Powered False 10:31:29.034553 run create_hlr_db(pid=26679): Terminated: ok {rc=0} 10:31:29.484013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26681): Launched 10:31:29.816132 run osmo-hlr_10.42.42.2(pid=26682): Launched 10:31:29.942337 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:30.519849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26684): Launched 10:31:30.861704 run osmo-stp_10.42.42.5(pid=26685): Launched 10:31:31.091047 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:31.763004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26687): Launched 10:31:31.925004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:32.211904 run patchelf(pid=26688): Launched 10:31:32.404822 run osmo-stp_10.42.42.5(pid=26685): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26685)] 10:31:32.535968 run osmo-stp_10.42.42.5(pid=26685): stdout: | (launched: 2022-12-09_10:31:30.791779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:32.668292 run osmo-stp_10.42.42.5(pid=26685): stderr: | 20221209103131111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103131112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103131112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103131112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103131114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103131116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103131117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:32.800535 run osmo-stp_10.42.42.5(pid=26685): stdout: | (launched: 2022-12-09_10:31:30.791779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:32.926793 run osmo-stp_10.42.42.5(pid=26685): stderr: | 20221209103131111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103131112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103131112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103131112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103131114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103131116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103131117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:33.076848 run patchelf(pid=26688): Terminating (SIGINT) 10:31:33.249851 run patchelf(pid=26688): Terminated: ok {rc=0} 10:31:33.374520 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26685): Process ended prematurely: osmo-stp_10.42.42.5(pid=26685) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26685)] [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 10:31:33.384308 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:31:33.412411 run osmo-hlr_10.42.42.2(pid=26682): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26682)] 10:31:33.460612 run osmo-hlr_10.42.42.2(pid=26682): stdout: | (launched: 2022-12-09_10:31:29.755722) 10:31:33.510698 run osmo-hlr_10.42.42.2(pid=26682): stderr: | 20221209103129952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103129953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103129953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103129953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103129953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103129953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103129972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103129982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103129983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103129983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:33.561064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26671): Terminating (SIGTERM) 10:31:33.601257 run iperf3-srv_10.42.42.10(pid=26672): Terminating (SIGTERM) 10:31:33.641696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26673): Terminating (SIGTERM) 10:31:33.682043 run iperf3-srv_10.42.42.10(pid=26674): Terminating (SIGTERM) 10:31:33.722440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26675): Terminating (SIGTERM) 10:31:33.762951 run iperf3-srv_10.42.42.10(pid=26676): Terminating (SIGTERM) 10:31:33.803664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26677): Terminating (SIGTERM) 10:31:33.844367 run iperf3-srv_10.42.42.10(pid=26678): Terminating (SIGTERM) 10:31:33.884739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26681): Terminating (SIGTERM) 10:31:33.925478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26684): Terminating (SIGTERM) 10:31:33.965937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26687): Terminating (SIGTERM) 10:31:34.006791 --- ParallelTerminationStrategy: PID 26671 died... 10:31:34.026207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26671): Terminated: ok {rc=0} 10:31:34.071015 --- ParallelTerminationStrategy: PID 26672 died... 10:31:34.090062 run iperf3-srv_10.42.42.10(pid=26672): Terminated {rc=256} 10:31:34.135280 --- ParallelTerminationStrategy: PID 26673 died... 10:31:34.154344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26673): Terminated: ok {rc=0} 10:31:34.199291 --- ParallelTerminationStrategy: PID 26674 died... 10:31:34.218602 run iperf3-srv_10.42.42.10(pid=26674): Terminated {rc=256} 10:31:34.263098 --- ParallelTerminationStrategy: PID 26675 died... 10:31:34.282113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26675): Terminated: ok {rc=0} 10:31:34.326590 --- ParallelTerminationStrategy: PID 26676 died... 10:31:34.345622 run iperf3-srv_10.42.42.10(pid=26676): Terminated {rc=256} 10:31:34.390222 --- ParallelTerminationStrategy: PID 26677 died... 10:31:34.409328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26677): Terminated: ok {rc=0} 10:31:34.455005 --- ParallelTerminationStrategy: PID 26678 died... 10:31:34.474043 run iperf3-srv_10.42.42.10(pid=26678): Terminated {rc=256} 10:31:34.518507 --- ParallelTerminationStrategy: PID 26681 died... 10:31:34.537503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26681): Terminated: ok {rc=0} 10:31:34.582491 --- ParallelTerminationStrategy: PID 26684 died... 10:31:34.601438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26684): Terminated: ok {rc=0} 10:31:34.645960 --- ParallelTerminationStrategy: PID 26687 died... 10:31:34.664909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26687): Terminated: ok {rc=0} 10:31:34.751881 bus /gobi_4: Setting Powered False 10:31:35.853185 bus /gobi_4: Setting Powered False 10:31:36.967126 bus /gobi_1: Setting Powered False 10:31:38.065511 bus /gobi_1: Setting Powered False 10:31:39.182979 bus /gobi_0: Setting Powered False 10:31:40.282167 bus /gobi_0: Setting Powered False 10:31:41.399732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 10:31:42.503274 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:42.515374 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:31:42.567105 tst ping.py: using LAC 20849 10:31:42.695358 tst ping.py: using RAC 194 10:31:42.824789 tst ping.py: using CellId 20849 10:31:42.953362 tst ping.py: using BVCI 20850 10:31:43.071804 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.083260 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.094504 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.106087 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.117551 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.128911 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.140628 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:43.152377 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:43.272702 tst ping.py:19: start network... 10:31:43.490192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:43.991723 run create_hlr_db(pid=26690): Launched 10:31:44.116603 bus /gobi_6: Setting Powered False 10:31:45.181317 run create_hlr_db(pid=26690): Terminated: ok {rc=0} 10:31:45.614983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26692): Launched 10:31:45.925761 run osmo-hlr_10.42.42.2(pid=26693): Launched 10:31:46.197428 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:46.932740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26695): Launched 10:31:47.285743 run osmo-stp_10.42.42.5(pid=26696): Launched 10:31:47.428940 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:47.990399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26698): Launched 10:31:48.117351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:48.390614 run patchelf(pid=26699): Launched 10:31:48.572841 run osmo-stp_10.42.42.5(pid=26696): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26696)] 10:31:48.710252 run osmo-stp_10.42.42.5(pid=26696): stdout: | (launched: 2022-12-09_10:31:47.217614) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:48.848679 run osmo-stp_10.42.42.5(pid=26696): stderr: | 20221209103147424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103147425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103147425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103147425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103147426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103147426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103147426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:48.987327 run osmo-stp_10.42.42.5(pid=26696): stdout: | (launched: 2022-12-09_10:31:47.217614) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:49.120846 run osmo-stp_10.42.42.5(pid=26696): stderr: | 20221209103147424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103147425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103147425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103147425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103147426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103147426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103147426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:49.278335 run patchelf(pid=26699): Terminating (SIGINT) 10:31:49.459294 run patchelf(pid=26699): Terminated: ok {rc=0} 10:31:49.589855 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26696): Process ended prematurely: osmo-stp_10.42.42.5(pid=26696) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26696)] [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 10:31:49.599623 tst ping.py:22: Test FAILED (7.1 sec) 10:31:49.629290 run osmo-hlr_10.42.42.2(pid=26693): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26693)] 10:31:49.680256 run osmo-hlr_10.42.42.2(pid=26693): stdout: | (launched: 2022-12-09_10:31:45.864622) 10:31:49.733254 run osmo-hlr_10.42.42.2(pid=26693): stderr: | 20221209103146179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103146179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103146179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103146180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103146180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103146180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103146199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103146220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103146220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103146220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:49.786600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26692): Terminating (SIGTERM) 10:31:49.829278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26695): Terminating (SIGTERM) 10:31:49.871981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26698): Terminating (SIGTERM) 10:31:49.915147 --- ParallelTerminationStrategy: PID 26692 died... 10:31:49.935158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26692): Terminated: ok {rc=0} 10:31:49.982719 --- ParallelTerminationStrategy: PID 26695 died... 10:31:50.002837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26695): Terminated: ok {rc=0} 10:31:50.050004 --- ParallelTerminationStrategy: PID 26698 died... 10:31:50.069905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26698): Terminated: ok {rc=0} 10:31:50.159288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:31:51.248316 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.260427 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:31:51.313408 tst ping_idle_ping.py: using LAC 20850 10:31:51.442038 tst ping_idle_ping.py: using RAC 195 10:31:51.569656 tst ping_idle_ping.py: using CellId 20850 10:31:51.690681 tst ping_idle_ping.py: using BVCI 20851 10:31:51.802620 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.813594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.824434 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.835659 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.846703 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.857834 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.869169 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:31:51.880258 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:31:52.001748 tst ping_idle_ping.py:24: start network... 10:31:52.221800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:52.728468 run create_hlr_db(pid=26700): Launched 10:31:52.853507 bus /gobi_6: Setting Powered False 10:31:53.918289 run create_hlr_db(pid=26700): Terminated: ok {rc=0} 10:31:54.355574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26702): Launched 10:31:54.682490 run osmo-hlr_10.42.42.2(pid=26703): Launched 10:31:54.809447 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:55.371137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26705): Launched 10:31:55.698788 run osmo-stp_10.42.42.5(pid=26706): Launched 10:31:55.823364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:56.385533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26708): Launched 10:31:56.511024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:56.787552 run patchelf(pid=26709): Launched 10:31:56.969380 run osmo-stp_10.42.42.5(pid=26706): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26706)] 10:31:57.108289 run osmo-stp_10.42.42.5(pid=26706): stdout: | (launched: 2022-12-09_10:31:55.639360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:57.247719 run osmo-stp_10.42.42.5(pid=26706): stderr: | 20221209103155828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103155828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103155828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103155829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103155829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103155829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103155829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:57.387463 run osmo-stp_10.42.42.5(pid=26706): stdout: | (launched: 2022-12-09_10:31:55.639360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:57.521645 run osmo-stp_10.42.42.5(pid=26706): stderr: | 20221209103155828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103155828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103155828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103155829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103155829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103155829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103155829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:57.680187 run patchelf(pid=26709): Terminating (SIGINT) 10:31:57.862845 run patchelf(pid=26709): Terminated: ok {rc=0} 10:31:57.994627 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26706): Process ended prematurely: osmo-stp_10.42.42.5(pid=26706) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26706)] [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 10:31:58.004705 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:31:58.034387 run osmo-hlr_10.42.42.2(pid=26703): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26703)] 10:31:58.086017 run osmo-hlr_10.42.42.2(pid=26703): stdout: | (launched: 2022-12-09_10:31:54.623135) 10:31:58.139238 run osmo-hlr_10.42.42.2(pid=26703): stderr: | 20221209103154819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103154819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103154819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103154819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103154819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103154819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103154832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103154841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103154841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103154841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:58.192870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26702): Terminating (SIGTERM) 10:31:58.235997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26705): Terminating (SIGTERM) 10:31:58.279360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26708): Terminating (SIGTERM) 10:31:58.322795 --- ParallelTerminationStrategy: PID 26702 died... 10:31:58.343378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26702): Terminated: ok {rc=0} 10:31:58.391605 --- ParallelTerminationStrategy: PID 26705 died... 10:31:58.411557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26705): Terminated: ok {rc=0} 10:31:58.459116 --- ParallelTerminationStrategy: PID 26708 died... 10:31:58.479152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26708): Terminated: ok {rc=0} 10:31:58.568738 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:31:59.870942 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:31:59.877060 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:31:59.909650 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:31:59.947542 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:32:00.034633 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:32:00.067850 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:32:00.105572 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:32:00.696470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:32:00.746435 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:00.757454 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:32:00.825329 tst cs_paging_gprs_active.py: using LAC 20851 10:32:00.952395 tst cs_paging_gprs_active.py: using RAC 196 10:32:01.078383 tst cs_paging_gprs_active.py: using CellId 20851 10:32:01.254297 tst cs_paging_gprs_active.py: using BVCI 20852 10:32:01.383233 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.395927 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.408517 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.423935 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.437625 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.450364 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.463929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.477022 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:01.491000 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:01.615301 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:01.741363 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:32:01.993944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:02.306651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Launched 10:32:02.601836 run iperf3-srv_10.42.42.10(pid=26715): Launched 10:32:02.721072 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:32:02.927468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:03.237951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26716): Launched 10:32:03.505682 run iperf3-srv_10.42.42.10(pid=26717): Launched 10:32:03.622040 tst cs_paging_gprs_active.py:38: start network... 10:32:03.828401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:04.308605 run create_hlr_db(pid=26718): Launched 10:32:04.435068 bus /gobi_6: Setting Powered False 10:32:05.496434 run create_hlr_db(pid=26718): Terminated: ok {rc=0} 10:32:05.948344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26720): Launched 10:32:06.262292 run osmo-hlr_10.42.42.2(pid=26721): Launched 10:32:06.379123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:06.922052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26723): Launched 10:32:07.230343 run osmo-stp_10.42.42.5(pid=26724): Launched 10:32:07.347466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:07.877224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26726): Launched 10:32:07.994823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:08.263159 run patchelf(pid=26727): Launched 10:32:08.435072 run osmo-stp_10.42.42.5(pid=26724): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26724)] 10:32:08.565150 run osmo-stp_10.42.42.5(pid=26724): stdout: | (launched: 2022-12-09_10:32:07.173655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:08.696394 run osmo-stp_10.42.42.5(pid=26724): stderr: | 20221209103207340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103207340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103207340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103207341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103207341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103207341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103207342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:08.827819 run osmo-stp_10.42.42.5(pid=26724): stdout: | (launched: 2022-12-09_10:32:07.173655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:08.953905 run osmo-stp_10.42.42.5(pid=26724): stderr: | 20221209103207340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103207340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103207340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103207341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103207341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103207341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103207342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:09.103800 run patchelf(pid=26727): Terminating (SIGINT) 10:32:09.276067 run patchelf(pid=26727): Terminated: ok {rc=0} 10:32:09.400276 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26724): Process ended prematurely: osmo-stp_10.42.42.5(pid=26724) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26724)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:32:09.409849 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:32:09.437348 run osmo-hlr_10.42.42.2(pid=26721): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26721)] 10:32:09.485243 run osmo-hlr_10.42.42.2(pid=26721): stdout: | (launched: 2022-12-09_10:32:06.205477) 10:32:09.534821 run osmo-hlr_10.42.42.2(pid=26721): stderr: | 20221209103206379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103206379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103206379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103206379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103206379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103206379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103206392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103206400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103206400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103206400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:09.584815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Terminating (SIGTERM) 10:32:09.624692 run iperf3-srv_10.42.42.10(pid=26715): Terminating (SIGTERM) 10:32:09.664376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26716): Terminating (SIGTERM) 10:32:09.704213 run iperf3-srv_10.42.42.10(pid=26717): Terminating (SIGTERM) 10:32:09.743827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26720): Terminating (SIGTERM) 10:32:09.784160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26723): Terminating (SIGTERM) 10:32:09.824119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26726): Terminating (SIGTERM) 10:32:09.864117 --- ParallelTerminationStrategy: PID 26714 died... 10:32:09.883339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Terminated: ok {rc=0} 10:32:09.927327 --- ParallelTerminationStrategy: PID 26715 died... 10:32:09.945971 run iperf3-srv_10.42.42.10(pid=26715): Terminated {rc=256} 10:32:09.989793 --- ParallelTerminationStrategy: PID 26716 died... 10:32:10.008538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26716): Terminated: ok {rc=0} 10:32:10.052422 --- ParallelTerminationStrategy: PID 26717 died... 10:32:10.071127 run iperf3-srv_10.42.42.10(pid=26717): Terminated {rc=256} 10:32:10.115500 --- ParallelTerminationStrategy: PID 26720 died... 10:32:10.134228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26720): Terminated: ok {rc=0} 10:32:10.178159 --- ParallelTerminationStrategy: PID 26723 died... 10:32:10.197012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26723): Terminated: ok {rc=0} 10:32:10.240829 --- ParallelTerminationStrategy: PID 26726 died... 10:32:10.259994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26726): Terminated: ok {rc=0} 10:32:10.347049 bus /gobi_0: Setting Powered False 10:32:11.448727 bus /gobi_0: Setting Powered False 10:32:12.566138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:32:13.713821 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:13.725287 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:32:13.793803 tst iperf3.py: using LAC 20852 10:32:13.916794 tst iperf3.py: using RAC 197 10:32:14.036775 tst iperf3.py: using CellId 20852 10:32:14.155780 tst iperf3.py: using BVCI 20853 10:32:14.268034 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.278900 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.289669 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.300239 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.310777 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.321493 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.332176 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.342681 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:14.353746 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:14.475489 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:32:14.698331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:15.029675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26728): Launched 10:32:15.320837 run iperf3-srv_10.42.42.10(pid=26729): Launched 10:32:15.445420 tst iperf3.py:8: start network... 10:32:15.667466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:16.178898 run create_hlr_db(pid=26730): Launched 10:32:16.338010 bus /gobi_6: Setting Powered False 10:32:17.398352 run create_hlr_db(pid=26730): Terminated: ok {rc=0} 10:32:17.848478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26732): Launched 10:32:18.179619 run osmo-hlr_10.42.42.2(pid=26733): Launched 10:32:18.305880 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:18.969459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26735): Launched 10:32:19.294119 run osmo-stp_10.42.42.5(pid=26736): Launched 10:32:19.419286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:19.977221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26738): Launched 10:32:20.101378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:20.375543 run patchelf(pid=26739): Launched 10:32:20.555212 run osmo-stp_10.42.42.5(pid=26736): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26736)] 10:32:20.691845 run osmo-stp_10.42.42.5(pid=26736): stdout: | (launched: 2022-12-09_10:32:19.235319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:20.829925 run osmo-stp_10.42.42.5(pid=26736): stderr: | 20221209103219423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103219423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103219423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103219424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103219424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103219424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103219424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:20.967771 run osmo-stp_10.42.42.5(pid=26736): stdout: | (launched: 2022-12-09_10:32:19.235319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:21.101220 run osmo-stp_10.42.42.5(pid=26736): stderr: | 20221209103219423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103219423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103219423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103219424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103219424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103219424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103219424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:21.258678 run patchelf(pid=26739): Terminating (SIGINT) 10:32:21.439224 run patchelf(pid=26739): Terminated: ok {rc=0} 10:32:21.569690 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26736): Process ended prematurely: osmo-stp_10.42.42.5(pid=26736) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26736)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 10:32:21.580093 tst iperf3.py:8: Test FAILED (7.9 sec) 10:32:21.609577 run osmo-hlr_10.42.42.2(pid=26733): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26733)] 10:32:21.660308 run osmo-hlr_10.42.42.2(pid=26733): stdout: | (launched: 2022-12-09_10:32:18.119289) 10:32:21.713070 run osmo-hlr_10.42.42.2(pid=26733): stderr: | 20221209103218314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103218314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103218314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103218314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103218314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103218314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103218326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103218336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103218336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103218336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:21.766273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26728): Terminating (SIGTERM) 10:32:21.808566 run iperf3-srv_10.42.42.10(pid=26729): Terminating (SIGTERM) 10:32:21.850891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26732): Terminating (SIGTERM) 10:32:21.893775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26735): Terminating (SIGTERM) 10:32:21.936401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26738): Terminating (SIGTERM) 10:32:21.979715 --- ParallelTerminationStrategy: PID 26728 died... 10:32:21.999946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26728): Terminated: ok {rc=0} 10:32:22.047722 --- ParallelTerminationStrategy: PID 26729 died... 10:32:22.067801 run iperf3-srv_10.42.42.10(pid=26729): Terminated {rc=256} 10:32:22.115120 --- ParallelTerminationStrategy: PID 26732 died... 10:32:22.135091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26732): Terminated: ok {rc=0} 10:32:22.182216 --- ParallelTerminationStrategy: PID 26735 died... 10:32:22.202131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26735): Terminated: ok {rc=0} 10:32:22.249883 --- ParallelTerminationStrategy: PID 26738 died... 10:32:22.269589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26738): Terminated: ok {rc=0} 10:32:22.359353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:32:23.509324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:23.521792 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:32:23.593778 tst iperf3m4.py: using LAC 20853 10:32:23.713314 tst iperf3m4.py: using RAC 198 10:32:23.833077 tst iperf3m4.py: using CellId 20853 10:32:23.950845 tst iperf3m4.py: using BVCI 20854 10:32:24.062916 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.073889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.084636 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.095232 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.105946 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.116547 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.127233 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.137674 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:24.148304 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:24.267564 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:24.389204 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:24.508640 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:24.628174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:32:24.830696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:25.134221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26740): Launched 10:32:25.397790 run iperf3-srv_10.42.42.10(pid=26741): Launched 10:32:25.512147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:32:25.714777 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:26.020460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26742): Launched 10:32:26.283963 run iperf3-srv_10.42.42.10(pid=26743): Launched 10:32:26.397224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:32:26.598181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:26.901742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26744): Launched 10:32:27.165498 run iperf3-srv_10.42.42.10(pid=26745): Launched 10:32:27.279421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:32:27.481680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:27.787423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26746): Launched 10:32:28.051029 run iperf3-srv_10.42.42.10(pid=26747): Launched 10:32:28.164285 tst iperf3m4.py:8: start network... 10:32:28.365869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:28.839760 run create_hlr_db(pid=26748): Launched 10:32:28.964812 bus /gobi_6: Setting Powered False 10:32:30.026090 run create_hlr_db(pid=26748): Terminated: ok {rc=0} 10:32:30.469167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26750): Launched 10:32:30.793538 run osmo-hlr_10.42.42.2(pid=26751): Launched 10:32:30.979546 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:31.644476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26753): Launched 10:32:31.974895 run osmo-stp_10.42.42.5(pid=26754): Launched 10:32:32.266377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:32.792520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26756): Launched 10:32:32.907724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:33.162656 run patchelf(pid=26757): Launched 10:32:33.330449 run osmo-stp_10.42.42.5(pid=26754): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26754)] 10:32:33.458472 run osmo-stp_10.42.42.5(pid=26754): stdout: | (launched: 2022-12-09_10:32:31.914509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:33.587697 run osmo-stp_10.42.42.5(pid=26754): stderr: | 20221209103232099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103232100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103232100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103232101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103232101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103232101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103232101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:33.716890 run osmo-stp_10.42.42.5(pid=26754): stdout: | (launched: 2022-12-09_10:32:31.914509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:33.840798 run osmo-stp_10.42.42.5(pid=26754): stderr: | 20221209103232099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103232100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103232100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103232101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103232101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103232101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103232101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:33.987671 run patchelf(pid=26757): Terminating (SIGINT) 10:32:34.156669 run patchelf(pid=26757): Terminated: ok {rc=0} 10:32:34.279166 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26754): Process ended prematurely: osmo-stp_10.42.42.5(pid=26754) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26754)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:32:34.289455 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:32:34.317333 run osmo-hlr_10.42.42.2(pid=26751): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26751)] 10:32:34.365173 run osmo-hlr_10.42.42.2(pid=26751): stdout: | (launched: 2022-12-09_10:32:30.734091) 10:32:34.414753 run osmo-hlr_10.42.42.2(pid=26751): stderr: | 20221209103231020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103231020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103231020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103231020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103231020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103231020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103231039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103231065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103231065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103231065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:34.464697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26740): Terminating (SIGTERM) 10:32:34.504654 run iperf3-srv_10.42.42.10(pid=26741): Terminating (SIGTERM) 10:32:34.544611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26742): Terminating (SIGTERM) 10:32:34.584257 run iperf3-srv_10.42.42.10(pid=26743): Terminating (SIGTERM) 10:32:34.623673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26744): Terminating (SIGTERM) 10:32:34.663246 run iperf3-srv_10.42.42.10(pid=26745): Terminating (SIGTERM) 10:32:34.702658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26746): Terminating (SIGTERM) 10:32:34.742287 run iperf3-srv_10.42.42.10(pid=26747): Terminating (SIGTERM) 10:32:34.781735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26750): Terminating (SIGTERM) 10:32:34.821502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26753): Terminating (SIGTERM) 10:32:34.861097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26756): Terminating (SIGTERM) 10:32:34.900922 --- ParallelTerminationStrategy: PID 26740 died... 10:32:34.919654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26740): Terminated: ok {rc=0} 10:32:34.963350 --- ParallelTerminationStrategy: PID 26741 died... 10:32:34.981744 run iperf3-srv_10.42.42.10(pid=26741): Terminated {rc=256} 10:32:35.025303 --- ParallelTerminationStrategy: PID 26742 died... 10:32:35.043691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26742): Terminated: ok {rc=0} 10:32:35.087793 --- ParallelTerminationStrategy: PID 26743 died... 10:32:35.106304 run iperf3-srv_10.42.42.10(pid=26743): Terminated {rc=256} 10:32:35.150917 --- ParallelTerminationStrategy: PID 26744 died... 10:32:35.169425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26744): Terminated: ok {rc=0} 10:32:35.213219 --- ParallelTerminationStrategy: PID 26745 died... 10:32:35.231746 run iperf3-srv_10.42.42.10(pid=26745): Terminated {rc=256} 10:32:35.275258 --- ParallelTerminationStrategy: PID 26746 died... 10:32:35.293907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26746): Terminated: ok {rc=0} 10:32:35.337718 --- ParallelTerminationStrategy: PID 26747 died... 10:32:35.356331 run iperf3-srv_10.42.42.10(pid=26747): Terminated {rc=256} 10:32:35.399942 --- ParallelTerminationStrategy: PID 26750 died... 10:32:35.418498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26750): Terminated: ok {rc=0} 10:32:35.462110 --- ParallelTerminationStrategy: PID 26753 died... 10:32:35.480580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26753): Terminated: ok {rc=0} 10:32:35.524159 --- ParallelTerminationStrategy: PID 26756 died... 10:32:35.542707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26756): Terminated: ok {rc=0} 10:32:35.628385 bus /gobi_4: Setting Powered False 10:32:36.729261 bus /gobi_4: Setting Powered False 10:32:37.845726 bus /gobi_1: Setting Powered False 10:32:38.947287 bus /gobi_1: Setting Powered False 10:32:40.064480 bus /gobi_0: Setting Powered False 10:32:41.164820 bus /gobi_0: Setting Powered False 10:32:42.281858 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:32:43.387096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:43.399158 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:32:43.471025 tst ping.py: using LAC 20854 10:32:43.595893 tst ping.py: using RAC 199 10:32:43.721987 tst ping.py: using CellId 20854 10:32:43.849762 tst ping.py: using BVCI 20855 10:32:43.967171 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:43.978632 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:43.989759 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:44.001265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:44.012459 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:44.023899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:44.035730 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:44.047013 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:44.162508 tst ping.py:19: start network... 10:32:44.360317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:44.825590 run create_hlr_db(pid=26761): Launched 10:32:44.949161 bus /gobi_6: Setting Powered False 10:32:46.023503 run create_hlr_db(pid=26761): Terminated: ok {rc=0} 10:32:46.511960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26763): Launched 10:32:46.848749 run osmo-hlr_10.42.42.2(pid=26764): Launched 10:32:47.150806 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:47.681643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26766): Launched 10:32:47.980549 run osmo-stp_10.42.42.5(pid=26767): Launched 10:32:48.105652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:48.657239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26769): Launched 10:32:48.779736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:49.048609 run patchelf(pid=26770): Launched 10:32:49.225992 run osmo-stp_10.42.42.5(pid=26767): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26767)] 10:32:49.361394 run osmo-stp_10.42.42.5(pid=26767): stdout: | (launched: 2022-12-09_10:32:47.925868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:49.497850 run osmo-stp_10.42.42.5(pid=26767): stderr: | 20221209103248110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103248110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103248110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103248110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103248111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103248111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103248111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:49.634599 run osmo-stp_10.42.42.5(pid=26767): stdout: | (launched: 2022-12-09_10:32:47.925868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:49.765209 run osmo-stp_10.42.42.5(pid=26767): stderr: | 20221209103248110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103248110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103248110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103248110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103248111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103248111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103248111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:49.919768 run patchelf(pid=26770): Terminating (SIGINT) 10:32:50.097631 run patchelf(pid=26770): Terminated: ok {rc=0} 10:32:50.225740 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26767): Process ended prematurely: osmo-stp_10.42.42.5(pid=26767) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26767)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 10:32:50.235462 tst ping.py:22: Test FAILED (6.8 sec) 10:32:50.264528 run osmo-hlr_10.42.42.2(pid=26764): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26764)] 10:32:50.315679 run osmo-hlr_10.42.42.2(pid=26764): stdout: | (launched: 2022-12-09_10:32:46.790581) 10:32:50.368606 run osmo-hlr_10.42.42.2(pid=26764): stderr: | 20221209103246996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103246996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103246996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103246996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103246996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103246997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103247015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103247039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103247039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103247039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:50.422213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26763): Terminating (SIGTERM) 10:32:50.464773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26766): Terminating (SIGTERM) 10:32:50.507263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26769): Terminating (SIGTERM) 10:32:50.549617 --- ParallelTerminationStrategy: PID 26763 died... 10:32:50.570300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26763): Terminated: ok {rc=0} 10:32:50.618169 --- ParallelTerminationStrategy: PID 26766 died... 10:32:50.637999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26766): Terminated: ok {rc=0} 10:32:50.685293 --- ParallelTerminationStrategy: PID 26769 died... 10:32:50.705218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26769): Terminated: ok {rc=0} 10:32:50.794498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:32:51.883609 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:51.895191 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:32:51.973526 tst ping_idle_ping.py: using LAC 20855 10:32:52.090543 tst ping_idle_ping.py: using RAC 200 10:32:52.216536 tst ping_idle_ping.py: using CellId 20855 10:32:52.346341 tst ping_idle_ping.py: using BVCI 20856 10:32:52.464135 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.475684 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.486999 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.498360 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.510283 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.521918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.533968 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:32:52.545475 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:32:52.659479 tst ping_idle_ping.py:24: start network... 10:32:52.858829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:53.320522 run create_hlr_db(pid=26771): Launched 10:32:53.444107 bus /gobi_6: Setting Powered False 10:32:54.503469 run create_hlr_db(pid=26771): Terminated: ok {rc=0} 10:32:54.940535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26773): Launched 10:32:55.259182 run osmo-hlr_10.42.42.2(pid=26774): Launched 10:32:55.382299 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:55.930787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26776): Launched 10:32:56.253590 run osmo-stp_10.42.42.5(pid=26777): Launched 10:32:56.376396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:56.929270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26779): Launched 10:32:57.053541 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:57.322695 run patchelf(pid=26780): Launched 10:32:57.502382 run osmo-stp_10.42.42.5(pid=26777): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26777)] 10:32:57.638240 run osmo-stp_10.42.42.5(pid=26777): stdout: | (launched: 2022-12-09_10:32:56.194854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:57.775043 run osmo-stp_10.42.42.5(pid=26777): stderr: | 20221209103256382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103256382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103256382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103256383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103256383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103256383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103256383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:57.911818 run osmo-stp_10.42.42.5(pid=26777): stdout: | (launched: 2022-12-09_10:32:56.194854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:58.043513 run osmo-stp_10.42.42.5(pid=26777): stderr: | 20221209103256382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103256382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103256382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103256383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103256383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103256383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103256383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:58.199826 run patchelf(pid=26780): Terminating (SIGINT) 10:32:58.379556 run patchelf(pid=26780): Terminated: ok {rc=0} 10:32:58.509575 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26777): Process ended prematurely: osmo-stp_10.42.42.5(pid=26777) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26777)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:32:58.519318 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:32:58.548153 run osmo-hlr_10.42.42.2(pid=26774): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26774)] 10:32:58.598571 run osmo-hlr_10.42.42.2(pid=26774): stdout: | (launched: 2022-12-09_10:32:55.201214) 10:32:58.650823 run osmo-hlr_10.42.42.2(pid=26774): stderr: | 20221209103255394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103255394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103255394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103255394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103255394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103255394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103255406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103255414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103255415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103255415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:58.703581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26773): Terminating (SIGTERM) 10:32:58.745669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26776): Terminating (SIGTERM) 10:32:58.788142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26779): Terminating (SIGTERM) 10:32:58.830671 --- ParallelTerminationStrategy: PID 26773 died... 10:32:58.850697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26773): Terminated: ok {rc=0} 10:32:58.897681 --- ParallelTerminationStrategy: PID 26776 died... 10:32:58.917279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26776): Terminated: ok {rc=0} 10:32:58.963682 --- ParallelTerminationStrategy: PID 26779 died... 10:32:58.983114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26779): Terminated: ok {rc=0} 10:32:59.071548 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:33:00.380053 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:00.387008 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:33:00.421538 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:33:00.460917 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:33:00.549293 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:33:00.582626 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:33:00.621887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:33:01.269914 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:33:01.341076 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:01.356911 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:33:01.456628 tst cs_paging_gprs_active.py: using LAC 20856 10:33:01.581279 tst cs_paging_gprs_active.py: using RAC 201 10:33:01.709271 tst cs_paging_gprs_active.py: using CellId 20856 10:33:01.835288 tst cs_paging_gprs_active.py: using BVCI 20857 10:33:01.955654 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:01.967566 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:01.979345 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:01.991637 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:02.003276 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:02.015436 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:02.027851 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:02.039909 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:02.051983 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:02.198871 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:02.327444 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:33:02.534410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:02.840819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26785): Launched 10:33:03.106677 run iperf3-srv_10.42.42.10(pid=26786): Launched 10:33:03.222131 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:33:03.425472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:03.731673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26787): Launched 10:33:03.996278 run iperf3-srv_10.42.42.10(pid=26788): Launched 10:33:04.111158 tst cs_paging_gprs_active.py:38: start network... 10:33:04.314407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:04.790222 run create_hlr_db(pid=26789): Launched 10:33:04.915429 bus /gobi_6: Setting Powered False 10:33:05.975598 run create_hlr_db(pid=26789): Terminated: ok {rc=0} 10:33:06.399779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26791): Launched 10:33:06.704509 run osmo-hlr_10.42.42.2(pid=26792): Launched 10:33:06.820487 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:07.349257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26794): Launched 10:33:07.653571 run osmo-stp_10.42.42.5(pid=26795): Launched 10:33:07.770671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:08.297382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26797): Launched 10:33:08.413432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:08.672702 run patchelf(pid=26798): Launched 10:33:08.842001 run osmo-stp_10.42.42.5(pid=26795): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26795)] 10:33:08.970247 run osmo-stp_10.42.42.5(pid=26795): stdout: | (launched: 2022-12-09_10:33:07.597381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:09.099901 run osmo-stp_10.42.42.5(pid=26795): stderr: | 20221209103307766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103307766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103307766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103307766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103307767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103307767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103307767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:09.229231 run osmo-stp_10.42.42.5(pid=26795): stdout: | (launched: 2022-12-09_10:33:07.597381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:09.353250 run osmo-stp_10.42.42.5(pid=26795): stderr: | 20221209103307766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103307766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103307766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103307766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103307767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103307767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103307767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:09.500548 run patchelf(pid=26798): Terminating (SIGINT) 10:33:09.670916 run patchelf(pid=26798): Terminated: ok {rc=0} 10:33:09.793467 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26795): Process ended prematurely: osmo-stp_10.42.42.5(pid=26795) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26795)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:33:09.803049 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:33:09.830423 run osmo-hlr_10.42.42.2(pid=26792): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26792)] 10:33:09.878223 run osmo-hlr_10.42.42.2(pid=26792): stdout: | (launched: 2022-12-09_10:33:06.648469) 10:33:09.927437 run osmo-hlr_10.42.42.2(pid=26792): stderr: | 20221209103306824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103306824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103306824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103306824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103306825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103306825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103306837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103306846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103306846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103306846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:09.977206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26785): Terminating (SIGTERM) 10:33:10.016940 run iperf3-srv_10.42.42.10(pid=26786): Terminating (SIGTERM) 10:33:10.056651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26787): Terminating (SIGTERM) 10:33:10.096274 run iperf3-srv_10.42.42.10(pid=26788): Terminating (SIGTERM) 10:33:10.135829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26791): Terminating (SIGTERM) 10:33:10.175580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26794): Terminating (SIGTERM) 10:33:10.215139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26797): Terminating (SIGTERM) 10:33:10.255025 --- ParallelTerminationStrategy: PID 26785 died... 10:33:10.274129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26785): Terminated: ok {rc=0} 10:33:10.318012 --- ParallelTerminationStrategy: PID 26786 died... 10:33:10.336394 run iperf3-srv_10.42.42.10(pid=26786): Terminated {rc=256} 10:33:10.380115 --- ParallelTerminationStrategy: PID 26787 died... 10:33:10.398787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26787): Terminated: ok {rc=0} 10:33:10.442952 --- ParallelTerminationStrategy: PID 26788 died... 10:33:10.461689 run iperf3-srv_10.42.42.10(pid=26788): Terminated {rc=256} 10:33:10.506345 --- ParallelTerminationStrategy: PID 26791 died... 10:33:10.525143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26791): Terminated: ok {rc=0} 10:33:10.569307 --- ParallelTerminationStrategy: PID 26794 died... 10:33:10.588507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26794): Terminated: ok {rc=0} 10:33:10.633351 --- ParallelTerminationStrategy: PID 26797 died... 10:33:10.651990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26797): Terminated: ok {rc=0} 10:33:10.736865 bus /gobi_0: Setting Powered False 10:33:11.836430 bus /gobi_0: Setting Powered False 10:33:12.954159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:33:14.101492 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.112811 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:33:14.181328 tst iperf3.py: using LAC 20857 10:33:14.301203 tst iperf3.py: using RAC 202 10:33:14.429176 tst iperf3.py: using CellId 20857 10:33:14.556816 tst iperf3.py: using BVCI 20858 10:33:14.675869 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.687432 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.698734 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.710479 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.722100 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.733860 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.745516 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.756920 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:14.768609 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:14.886598 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:33:15.088329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:15.391915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26800): Launched 10:33:15.655850 run iperf3-srv_10.42.42.10(pid=26801): Launched 10:33:15.769704 tst iperf3.py:8: start network... 10:33:15.974620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:16.454142 run create_hlr_db(pid=26802): Launched 10:33:16.620918 bus /gobi_6: Setting Powered False 10:33:17.685433 run create_hlr_db(pid=26802): Terminated: ok {rc=0} 10:33:18.119423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26804): Launched 10:33:18.422912 run osmo-hlr_10.42.42.2(pid=26805): Launched 10:33:18.538083 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:19.065956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26807): Launched 10:33:19.369986 run osmo-stp_10.42.42.5(pid=26808): Launched 10:33:19.485233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:20.010163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26810): Launched 10:33:20.125444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:20.381178 run patchelf(pid=26811): Launched 10:33:20.550074 run osmo-stp_10.42.42.5(pid=26808): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26808)] 10:33:20.678380 run osmo-stp_10.42.42.5(pid=26808): stdout: | (launched: 2022-12-09_10:33:19.314104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:20.807569 run osmo-stp_10.42.42.5(pid=26808): stderr: | 20221209103319481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103319481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103319482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103319482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103319482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103319483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103319483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:20.936892 run osmo-stp_10.42.42.5(pid=26808): stdout: | (launched: 2022-12-09_10:33:19.314104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:21.060837 run osmo-stp_10.42.42.5(pid=26808): stderr: | 20221209103319481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103319481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103319482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103319482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103319482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103319483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103319483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:21.208103 run patchelf(pid=26811): Terminating (SIGINT) 10:33:21.378403 run patchelf(pid=26811): Terminated: ok {rc=0} 10:33:21.501366 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26808): Process ended prematurely: osmo-stp_10.42.42.5(pid=26808) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26808)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 10:33:21.510913 tst iperf3.py:8: Test FAILED (7.4 sec) 10:33:21.538178 run osmo-hlr_10.42.42.2(pid=26805): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26805)] 10:33:21.585769 run osmo-hlr_10.42.42.2(pid=26805): stdout: | (launched: 2022-12-09_10:33:18.366677) 10:33:21.635312 run osmo-hlr_10.42.42.2(pid=26805): stderr: | 20221209103318539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103318539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103318539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103318539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103318539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103318539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103318551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103318560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103318560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103318560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:21.685447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26800): Terminating (SIGTERM) 10:33:21.725464 run iperf3-srv_10.42.42.10(pid=26801): Terminating (SIGTERM) 10:33:21.765177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26804): Terminating (SIGTERM) 10:33:21.805122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26807): Terminating (SIGTERM) 10:33:21.845244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26810): Terminating (SIGTERM) 10:33:21.886286 --- ParallelTerminationStrategy: PID 26800 died... 10:33:21.905271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26800): Terminated: ok {rc=0} 10:33:21.949661 --- ParallelTerminationStrategy: PID 26801 died... 10:33:21.968153 run iperf3-srv_10.42.42.10(pid=26801): Terminated {rc=256} 10:33:22.012080 --- ParallelTerminationStrategy: PID 26804 died... 10:33:22.030600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26804): Terminated: ok {rc=0} 10:33:22.074449 --- ParallelTerminationStrategy: PID 26807 died... 10:33:22.093160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26807): Terminated: ok {rc=0} 10:33:22.137175 --- ParallelTerminationStrategy: PID 26810 died... 10:33:22.155744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26810): Terminated: ok {rc=0} 10:33:22.242111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:33:23.391501 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:23.402990 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:33:23.472617 tst iperf3m4.py: using LAC 20858 10:33:23.591622 tst iperf3m4.py: using RAC 203 10:33:23.712810 tst iperf3m4.py: using CellId 20858 10:33:23.833244 tst iperf3m4.py: using BVCI 20859 10:33:23.942458 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:23.953487 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:23.964141 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:23.974820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:23.985434 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:23.996026 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:24.006830 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:24.017467 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:24.028233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:24.145280 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:24.265112 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:24.385989 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:24.502481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:33:24.705169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:25.008778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26812): Launched 10:33:25.273359 run iperf3-srv_10.42.42.10(pid=26813): Launched 10:33:25.387821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:33:25.591564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:25.897163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26814): Launched 10:33:26.162076 run iperf3-srv_10.42.42.10(pid=26815): Launched 10:33:26.276458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:33:26.477467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:26.782227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26816): Launched 10:33:27.046834 run iperf3-srv_10.42.42.10(pid=26817): Launched 10:33:27.160661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:33:27.362035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:27.665513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26818): Launched 10:33:27.930863 run iperf3-srv_10.42.42.10(pid=26819): Launched 10:33:28.044268 tst iperf3m4.py:8: start network... 10:33:28.245859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:28.718607 run create_hlr_db(pid=26820): Launched 10:33:28.843599 bus /gobi_6: Setting Powered False 10:33:29.903866 run create_hlr_db(pid=26820): Terminated: ok {rc=0} 10:33:30.347715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26822): Launched 10:33:30.673700 run osmo-hlr_10.42.42.2(pid=26823): Launched 10:33:30.798483 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:31.528519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26826): Launched 10:33:31.907558 run osmo-stp_10.42.42.5(pid=26827): Launched 10:33:32.037871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:32.772513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26829): Launched 10:33:32.897264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:33.171191 run patchelf(pid=26830): Launched 10:33:33.351563 run osmo-stp_10.42.42.5(pid=26827): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26827)] 10:33:33.488878 run osmo-stp_10.42.42.5(pid=26827): stdout: | (launched: 2022-12-09_10:33:31.844822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:33.627442 run osmo-stp_10.42.42.5(pid=26827): stderr: | 20221209103332271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103332271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103332272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103332273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103332274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103332274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103332274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:33.766389 run osmo-stp_10.42.42.5(pid=26827): stdout: | (launched: 2022-12-09_10:33:31.844822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:33.899479 run osmo-stp_10.42.42.5(pid=26827): stderr: | 20221209103332271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103332271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103332272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103332273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103332274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103332274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103332274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:34.057938 run patchelf(pid=26830): Terminating (SIGINT) 10:33:34.240087 run patchelf(pid=26830): Terminated: ok {rc=0} 10:33:34.371555 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26827): Process ended prematurely: osmo-stp_10.42.42.5(pid=26827) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26827)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:33:34.382116 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:33:34.411819 run osmo-hlr_10.42.42.2(pid=26823): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26823)] 10:33:34.463516 run osmo-hlr_10.42.42.2(pid=26823): stdout: | (launched: 2022-12-09_10:33:30.613587) 10:33:34.516655 run osmo-hlr_10.42.42.2(pid=26823): stderr: | 20221209103330813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103330813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103330813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103330813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103330813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103330813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103330826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103330856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103330856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103330856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:34.570372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26812): Terminating (SIGTERM) 10:33:34.613241 run iperf3-srv_10.42.42.10(pid=26813): Terminating (SIGTERM) 10:33:34.656006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26814): Terminating (SIGTERM) 10:33:34.698788 run iperf3-srv_10.42.42.10(pid=26815): Terminating (SIGTERM) 10:33:34.741401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26816): Terminating (SIGTERM) 10:33:34.784612 run iperf3-srv_10.42.42.10(pid=26817): Terminating (SIGTERM) 10:33:34.827874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26818): Terminating (SIGTERM) 10:33:34.870241 run iperf3-srv_10.42.42.10(pid=26819): Terminating (SIGTERM) 10:33:34.913294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26822): Terminating (SIGTERM) 10:33:34.955958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26826): Terminating (SIGTERM) 10:33:34.998975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26829): Terminating (SIGTERM) 10:33:35.042051 --- ParallelTerminationStrategy: PID 26812 died... 10:33:35.062335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26812): Terminated: ok {rc=0} 10:33:35.110057 --- ParallelTerminationStrategy: PID 26813 died... 10:33:35.129911 run iperf3-srv_10.42.42.10(pid=26813): Terminated {rc=256} 10:33:35.177196 --- ParallelTerminationStrategy: PID 26814 died... 10:33:35.196823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26814): Terminated: ok {rc=0} 10:33:35.244113 --- ParallelTerminationStrategy: PID 26815 died... 10:33:35.263904 run iperf3-srv_10.42.42.10(pid=26815): Terminated {rc=256} 10:33:35.311160 --- ParallelTerminationStrategy: PID 26816 died... 10:33:35.331002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26816): Terminated: ok {rc=0} 10:33:35.378313 --- ParallelTerminationStrategy: PID 26817 died... 10:33:35.398135 run iperf3-srv_10.42.42.10(pid=26817): Terminated {rc=256} 10:33:35.445535 --- ParallelTerminationStrategy: PID 26818 died... 10:33:35.465460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26818): Terminated: ok {rc=0} 10:33:35.513012 --- ParallelTerminationStrategy: PID 26819 died... 10:33:35.532729 run iperf3-srv_10.42.42.10(pid=26819): Terminated {rc=256} 10:33:35.579961 --- ParallelTerminationStrategy: PID 26822 died... 10:33:35.599934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26822): Terminated: ok {rc=0} 10:33:35.647586 --- ParallelTerminationStrategy: PID 26826 died... 10:33:35.667457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26826): Terminated: ok {rc=0} 10:33:35.714610 --- ParallelTerminationStrategy: PID 26829 died... 10:33:35.734563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26829): Terminated: ok {rc=0} 10:33:35.824105 bus /gobi_4: Setting Powered False 10:33:36.926072 bus /gobi_4: Setting Powered False 10:33:38.044016 bus /gobi_1: Setting Powered False 10:33:39.143951 bus /gobi_1: Setting Powered False 10:33:40.264476 bus /gobi_0: Setting Powered False 10:33:41.364893 bus /gobi_0: Setting Powered False 10:33:42.486091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:33:43.590905 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:43.602301 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:33:43.671163 tst ping.py: using LAC 20859 10:33:43.787405 tst ping.py: using RAC 204 10:33:43.903627 tst ping.py: using CellId 20859 10:33:44.021135 tst ping.py: using BVCI 20860 10:33:44.128414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.139332 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.150119 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.160794 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.171499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.182247 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.193023 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:44.203648 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:44.316626 tst ping.py:19: start network... 10:33:44.512650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:44.976039 run create_hlr_db(pid=26831): Launched 10:33:45.097964 bus /gobi_6: Setting Powered False 10:33:46.158048 run create_hlr_db(pid=26831): Terminated: ok {rc=0} 10:33:46.586371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26833): Launched 10:33:46.904847 run osmo-hlr_10.42.42.2(pid=26834): Launched 10:33:47.160909 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:47.731057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26836): Launched 10:33:48.049889 run osmo-stp_10.42.42.5(pid=26837): Launched 10:33:48.174341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:48.727098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26839): Launched 10:33:48.849611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:49.118901 run patchelf(pid=26840): Launched 10:33:49.296753 run osmo-stp_10.42.42.5(pid=26837): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26837)] 10:33:49.432277 run osmo-stp_10.42.42.5(pid=26837): stdout: | (launched: 2022-12-09_10:33:47.992083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:49.568783 run osmo-stp_10.42.42.5(pid=26837): stderr: | 20221209103348179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103348179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103348179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103348180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103348180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103348180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103348180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:49.705813 run osmo-stp_10.42.42.5(pid=26837): stdout: | (launched: 2022-12-09_10:33:47.992083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:49.837191 run osmo-stp_10.42.42.5(pid=26837): stderr: | 20221209103348179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103348179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103348179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103348180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103348180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103348180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103348180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:49.992127 run patchelf(pid=26840): Terminating (SIGINT) 10:33:50.171400 run patchelf(pid=26840): Terminated: ok {rc=0} 10:33:50.300281 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26837): Process ended prematurely: osmo-stp_10.42.42.5(pid=26837) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26837)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 10:33:50.310050 tst ping.py:22: Test FAILED (6.7 sec) 10:33:50.339207 run osmo-hlr_10.42.42.2(pid=26834): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26834)] 10:33:50.390750 run osmo-hlr_10.42.42.2(pid=26834): stdout: | (launched: 2022-12-09_10:33:46.848347) 10:33:50.444000 run osmo-hlr_10.42.42.2(pid=26834): stderr: | 20221209103347055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103347055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103347055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103347055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103347055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103347056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103347075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103347090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103347090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103347090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:50.498072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26833): Terminating (SIGTERM) 10:33:50.541141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26836): Terminating (SIGTERM) 10:33:50.584120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26839): Terminating (SIGTERM) 10:33:50.627276 --- ParallelTerminationStrategy: PID 26833 died... 10:33:50.647552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26833): Terminated: ok {rc=0} 10:33:50.694993 --- ParallelTerminationStrategy: PID 26836 died... 10:33:50.714967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26836): Terminated: ok {rc=0} 10:33:50.761980 --- ParallelTerminationStrategy: PID 26839 died... 10:33:50.781999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26839): Terminated: ok {rc=0} 10:33:50.871802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:33:51.962342 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:51.975086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:33:52.053693 tst ping_idle_ping.py: using LAC 20860 10:33:52.181379 tst ping_idle_ping.py: using RAC 205 10:33:52.307411 tst ping_idle_ping.py: using CellId 20860 10:33:52.433331 tst ping_idle_ping.py: using BVCI 20861 10:33:52.549429 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.560688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.571926 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.583342 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.594721 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.605953 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.618640 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:33:52.630602 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:33:52.748082 tst ping_idle_ping.py:24: start network... 10:33:52.963444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:53.458278 run create_hlr_db(pid=26841): Launched 10:33:53.580088 bus /gobi_6: Setting Powered False 10:33:54.642881 run create_hlr_db(pid=26841): Terminated: ok {rc=0} 10:33:55.069359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26843): Launched 10:33:55.367876 run osmo-hlr_10.42.42.2(pid=26844): Launched 10:33:55.481580 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:55.993754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26846): Launched 10:33:56.292630 run osmo-stp_10.42.42.5(pid=26847): Launched 10:33:56.406452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:56.924519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26849): Launched 10:33:57.039462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:57.290801 run patchelf(pid=26850): Launched 10:33:57.456798 run osmo-stp_10.42.42.5(pid=26847): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26847)] 10:33:57.584226 run osmo-stp_10.42.42.5(pid=26847): stdout: | (launched: 2022-12-09_10:33:56.237791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:57.712104 run osmo-stp_10.42.42.5(pid=26847): stderr: | 20221209103356404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103356404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103356405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103356405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103356406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103356406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103356406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:57.840247 run osmo-stp_10.42.42.5(pid=26847): stdout: | (launched: 2022-12-09_10:33:56.237791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:57.963026 run osmo-stp_10.42.42.5(pid=26847): stderr: | 20221209103356404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103356404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103356405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103356405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103356406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103356406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103356406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:58.108579 run patchelf(pid=26850): Terminating (SIGINT) 10:33:58.275791 run patchelf(pid=26850): Terminated: ok {rc=0} 10:33:58.396270 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26847): Process ended prematurely: osmo-stp_10.42.42.5(pid=26847) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26847)] [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:33:58.405361 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:33:58.432266 run osmo-hlr_10.42.42.2(pid=26844): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26844)] 10:33:58.480167 run osmo-hlr_10.42.42.2(pid=26844): stdout: | (launched: 2022-12-09_10:33:55.312689) 10:33:58.529850 run osmo-hlr_10.42.42.2(pid=26844): stderr: | 20221209103355483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103355483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103355483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103355483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103355483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103355483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103355496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103355504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103355505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103355505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:58.580035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26843): Terminating (SIGTERM) 10:33:58.620031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26846): Terminating (SIGTERM) 10:33:58.659983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26849): Terminating (SIGTERM) 10:33:58.700220 --- ParallelTerminationStrategy: PID 26843 died... 10:33:58.719584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26843): Terminated: ok {rc=0} 10:33:58.763761 --- ParallelTerminationStrategy: PID 26846 died... 10:33:58.782388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26846): Terminated: ok {rc=0} 10:33:58.826137 --- ParallelTerminationStrategy: PID 26849 died... 10:33:58.844807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26849): Terminated: ok {rc=0} 10:33:58.929026 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:34:00.238466 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:00.246072 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:34:00.281933 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:34:00.322099 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:34:00.411832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:34:00.444727 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:34:00.484863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:34:01.140030 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:34:01.197563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.210098 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:34:01.272883 tst cs_paging_gprs_active.py: using LAC 20861 10:34:01.410320 tst cs_paging_gprs_active.py: using RAC 206 10:34:01.532764 tst cs_paging_gprs_active.py: using CellId 20861 10:34:01.657450 tst cs_paging_gprs_active.py: using BVCI 20862 10:34:01.816926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.832312 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.848502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.864514 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.880158 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.894011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.910157 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.926466 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:01.943122 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:02.091559 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:02.233969 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:34:02.455641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:02.783007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26854): Launched 10:34:03.068998 run iperf3-srv_10.42.42.10(pid=26855): Launched 10:34:03.192244 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:34:03.411771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:03.738184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26856): Launched 10:34:04.023564 run iperf3-srv_10.42.42.10(pid=26857): Launched 10:34:04.147248 tst cs_paging_gprs_active.py:38: start network... 10:34:04.366351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:04.871816 run create_hlr_db(pid=26858): Launched 10:34:04.996671 bus /gobi_6: Setting Powered False 10:34:06.060744 run create_hlr_db(pid=26858): Terminated: ok {rc=0} 10:34:06.497565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26860): Launched 10:34:06.805584 run osmo-hlr_10.42.42.2(pid=26861): Launched 10:34:06.923091 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:07.451193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26863): Launched 10:34:07.755402 run osmo-stp_10.42.42.5(pid=26864): Launched 10:34:07.875586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:08.402237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26866): Launched 10:34:08.518281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:08.774976 run patchelf(pid=26867): Launched 10:34:08.944087 run osmo-stp_10.42.42.5(pid=26864): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26864)] 10:34:09.073426 run osmo-stp_10.42.42.5(pid=26864): stdout: | (launched: 2022-12-09_10:34:07.699551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:09.203403 run osmo-stp_10.42.42.5(pid=26864): stderr: | 20221209103407866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103407866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103407867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103407867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103407867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103407868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103407868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:09.333236 run osmo-stp_10.42.42.5(pid=26864): stdout: | (launched: 2022-12-09_10:34:07.699551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:09.457919 run osmo-stp_10.42.42.5(pid=26864): stderr: | 20221209103407866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103407866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103407867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103407867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103407867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103407868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103407868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:09.605278 run patchelf(pid=26867): Terminating (SIGINT) 10:34:09.774820 run patchelf(pid=26867): Terminated: ok {rc=0} 10:34:09.897465 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26864): Process ended prematurely: osmo-stp_10.42.42.5(pid=26864) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26864)] [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:34:09.906978 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:34:09.934518 run osmo-hlr_10.42.42.2(pid=26861): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26861)] 10:34:09.982447 run osmo-hlr_10.42.42.2(pid=26861): stdout: | (launched: 2022-12-09_10:34:06.749321) 10:34:10.032173 run osmo-hlr_10.42.42.2(pid=26861): stderr: | 20221209103406923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103406923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103406923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103406923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103406923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103406923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103406938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103406948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103406948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103406949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:10.082557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26854): Terminating (SIGTERM) 10:34:10.122609 run iperf3-srv_10.42.42.10(pid=26855): Terminating (SIGTERM) 10:34:10.162452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26856): Terminating (SIGTERM) 10:34:10.202413 run iperf3-srv_10.42.42.10(pid=26857): Terminating (SIGTERM) 10:34:10.242147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26860): Terminating (SIGTERM) 10:34:10.282028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26863): Terminating (SIGTERM) 10:34:10.321866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26866): Terminating (SIGTERM) 10:34:10.361717 --- ParallelTerminationStrategy: PID 26854 died... 10:34:10.380898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26854): Terminated: ok {rc=0} 10:34:10.425632 --- ParallelTerminationStrategy: PID 26855 died... 10:34:10.444227 run iperf3-srv_10.42.42.10(pid=26855): Terminated {rc=256} 10:34:10.487955 --- ParallelTerminationStrategy: PID 26856 died... 10:34:10.506601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26856): Terminated: ok {rc=0} 10:34:10.550456 --- ParallelTerminationStrategy: PID 26857 died... 10:34:10.569265 run iperf3-srv_10.42.42.10(pid=26857): Terminated {rc=256} 10:34:10.613128 --- ParallelTerminationStrategy: PID 26860 died... 10:34:10.631635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26860): Terminated: ok {rc=0} 10:34:10.675404 --- ParallelTerminationStrategy: PID 26863 died... 10:34:10.694206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26863): Terminated: ok {rc=0} 10:34:10.738363 --- ParallelTerminationStrategy: PID 26866 died... 10:34:10.757160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26866): Terminated: ok {rc=0} 10:34:10.843424 bus /gobi_0: Setting Powered False 10:34:11.958332 bus /gobi_0: Setting Powered False 10:34:13.075367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:34:14.226372 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.238908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:34:14.294679 tst iperf3.py: using LAC 20862 10:34:14.423780 tst iperf3.py: using RAC 207 10:34:14.554015 tst iperf3.py: using CellId 20862 10:34:14.681648 tst iperf3.py: using BVCI 20863 10:34:14.801670 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.813597 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.825334 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.837134 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.848736 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.860483 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.872472 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.884239 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:14.896316 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:15.015695 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:34:15.234422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:15.560205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26868): Launched 10:34:15.847756 run iperf3-srv_10.42.42.10(pid=26869): Launched 10:34:15.978306 tst iperf3.py:8: start network... 10:34:16.188247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:16.675295 run create_hlr_db(pid=26870): Launched 10:34:16.840345 bus /gobi_6: Setting Powered False 10:34:17.900870 run create_hlr_db(pid=26870): Terminated: ok {rc=0} 10:34:18.344887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26872): Launched 10:34:18.670053 run osmo-hlr_10.42.42.2(pid=26873): Launched 10:34:18.795341 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:19.362043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26875): Launched 10:34:19.687493 run osmo-stp_10.42.42.5(pid=26876): Launched 10:34:19.813334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:20.374960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26878): Launched 10:34:20.499904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:20.775592 run patchelf(pid=26879): Launched 10:34:20.956508 run osmo-stp_10.42.42.5(pid=26876): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26876)] 10:34:21.094464 run osmo-stp_10.42.42.5(pid=26876): stdout: | (launched: 2022-12-09_10:34:19.628159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:21.233717 run osmo-stp_10.42.42.5(pid=26876): stderr: | 20221209103419816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103419816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103419817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103419817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103419818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103419818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103419818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:21.372809 run osmo-stp_10.42.42.5(pid=26876): stdout: | (launched: 2022-12-09_10:34:19.628159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:21.506435 run osmo-stp_10.42.42.5(pid=26876): stderr: | 20221209103419816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103419816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103419817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103419817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103419818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103419818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103419818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:21.664557 run patchelf(pid=26879): Terminating (SIGINT) 10:34:21.847124 run patchelf(pid=26879): Terminated: ok {rc=0} 10:34:21.978752 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26876): Process ended prematurely: osmo-stp_10.42.42.5(pid=26876) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26876)] [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:34:21.989185 tst iperf3.py:8: Test FAILED (7.8 sec) 10:34:22.018978 run osmo-hlr_10.42.42.2(pid=26873): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26873)] 10:34:22.069724 run osmo-hlr_10.42.42.2(pid=26873): stdout: | (launched: 2022-12-09_10:34:18.610567) 10:34:22.122753 run osmo-hlr_10.42.42.2(pid=26873): stderr: | 20221209103418805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103418805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103418805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103418806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103418806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103418806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103418819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103418830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103418830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103418830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:22.176077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26868): Terminating (SIGTERM) 10:34:22.218586 run iperf3-srv_10.42.42.10(pid=26869): Terminating (SIGTERM) 10:34:22.260861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26872): Terminating (SIGTERM) 10:34:22.303280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26875): Terminating (SIGTERM) 10:34:22.345869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26878): Terminating (SIGTERM) 10:34:22.388437 --- ParallelTerminationStrategy: PID 26868 died... 10:34:22.408569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26868): Terminated: ok {rc=0} 10:34:22.455654 --- ParallelTerminationStrategy: PID 26869 died... 10:34:22.475328 run iperf3-srv_10.42.42.10(pid=26869): Terminated {rc=256} 10:34:22.521994 --- ParallelTerminationStrategy: PID 26872 died... 10:34:22.541976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26872): Terminated: ok {rc=0} 10:34:22.588812 --- ParallelTerminationStrategy: PID 26875 died... 10:34:22.608808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26875): Terminated: ok {rc=0} 10:34:22.655782 --- ParallelTerminationStrategy: PID 26878 died... 10:34:22.675679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26878): Terminated: ok {rc=0} 10:34:22.765382 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:34:23.916626 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:23.929154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:34:23.982409 tst iperf3m4.py: using LAC 20863 10:34:24.112148 tst iperf3m4.py: using RAC 208 10:34:24.239432 tst iperf3m4.py: using CellId 20863 10:34:24.372478 tst iperf3m4.py: using BVCI 20864 10:34:24.492801 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.504578 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.516175 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.528048 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.539814 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.551522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.563394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.575178 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:24.587184 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:24.704927 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:24.829288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:24.951033 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:25.070197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:34:25.274200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:25.579119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26880): Launched 10:34:25.845169 run iperf3-srv_10.42.42.10(pid=26881): Launched 10:34:25.958596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:34:26.160229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:26.464157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26882): Launched 10:34:26.728814 run iperf3-srv_10.42.42.10(pid=26883): Launched 10:34:26.842697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:34:27.043864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:27.348229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26884): Launched 10:34:27.611738 run iperf3-srv_10.42.42.10(pid=26885): Launched 10:34:27.725730 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:34:27.927263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:28.230480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26886): Launched 10:34:28.495924 run iperf3-srv_10.42.42.10(pid=26887): Launched 10:34:28.609860 tst iperf3m4.py:8: start network... 10:34:28.811128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:29.283850 run create_hlr_db(pid=26888): Launched 10:34:29.409558 bus /gobi_6: Setting Powered False 10:34:30.469878 run create_hlr_db(pid=26888): Terminated: ok {rc=0} 10:34:30.929773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26890): Launched 10:34:31.255523 run osmo-hlr_10.42.42.2(pid=26891): Launched 10:34:31.499635 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:32.169784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26893): Launched 10:34:32.508116 run osmo-stp_10.42.42.5(pid=26894): Launched 10:34:32.633530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:33.194653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26896): Launched 10:34:33.319975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:33.594183 run patchelf(pid=26897): Launched 10:34:33.776397 run osmo-stp_10.42.42.5(pid=26894): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26894)] 10:34:33.913837 run osmo-stp_10.42.42.5(pid=26894): stdout: | (launched: 2022-12-09_10:34:32.448300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:34.052397 run osmo-stp_10.42.42.5(pid=26894): stderr: | 20221209103432637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103432637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103432637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103432637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103432638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103432638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103432638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:34.191619 run osmo-stp_10.42.42.5(pid=26894): stdout: | (launched: 2022-12-09_10:34:32.448300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:34.325061 run osmo-stp_10.42.42.5(pid=26894): stderr: | 20221209103432637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103432637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103432637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103432637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103432638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103432638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103432638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:34.483298 run patchelf(pid=26897): Terminating (SIGINT) 10:34:34.664897 run patchelf(pid=26897): Terminated: ok {rc=0} 10:34:34.796020 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26894): Process ended prematurely: osmo-stp_10.42.42.5(pid=26894) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26894)] [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:34:34.806451 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:34:34.836631 run osmo-hlr_10.42.42.2(pid=26891): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26891)] 10:34:34.888125 run osmo-hlr_10.42.42.2(pid=26891): stdout: | (launched: 2022-12-09_10:34:31.193916) 10:34:34.941130 run osmo-hlr_10.42.42.2(pid=26891): stderr: | 20221209103431532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103431532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103431532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103431532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103431532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103431532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103431549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103431561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103431561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103431561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:34.994704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26880): Terminating (SIGTERM) 10:34:35.037459 run iperf3-srv_10.42.42.10(pid=26881): Terminating (SIGTERM) 10:34:35.079885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26882): Terminating (SIGTERM) 10:34:35.122809 run iperf3-srv_10.42.42.10(pid=26883): Terminating (SIGTERM) 10:34:35.164788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26884): Terminating (SIGTERM) 10:34:35.207658 run iperf3-srv_10.42.42.10(pid=26885): Terminating (SIGTERM) 10:34:35.250057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26886): Terminating (SIGTERM) 10:34:35.292602 run iperf3-srv_10.42.42.10(pid=26887): Terminating (SIGTERM) 10:34:35.334989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26890): Terminating (SIGTERM) 10:34:35.377544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26893): Terminating (SIGTERM) 10:34:35.420052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26896): Terminating (SIGTERM) 10:34:35.462943 --- ParallelTerminationStrategy: PID 26880 died... 10:34:35.483137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26880): Terminated: ok {rc=0} 10:34:35.530116 --- ParallelTerminationStrategy: PID 26881 died... 10:34:35.549555 run iperf3-srv_10.42.42.10(pid=26881): Terminated {rc=256} 10:34:35.596217 --- ParallelTerminationStrategy: PID 26882 died... 10:34:35.615974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26882): Terminated: ok {rc=0} 10:34:35.662872 --- ParallelTerminationStrategy: PID 26883 died... 10:34:35.682854 run iperf3-srv_10.42.42.10(pid=26883): Terminated {rc=256} 10:34:35.729568 --- ParallelTerminationStrategy: PID 26884 died... 10:34:35.749155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26884): Terminated: ok {rc=0} 10:34:35.795791 --- ParallelTerminationStrategy: PID 26885 died... 10:34:35.815442 run iperf3-srv_10.42.42.10(pid=26885): Terminated {rc=256} 10:34:35.862131 --- ParallelTerminationStrategy: PID 26886 died... 10:34:35.881858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26886): Terminated: ok {rc=0} 10:34:35.928354 --- ParallelTerminationStrategy: PID 26887 died... 10:34:35.947871 run iperf3-srv_10.42.42.10(pid=26887): Terminated {rc=256} 10:34:35.994462 --- ParallelTerminationStrategy: PID 26890 died... 10:34:36.014262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26890): Terminated: ok {rc=0} 10:34:36.061078 --- ParallelTerminationStrategy: PID 26893 died... 10:34:36.080656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26893): Terminated: ok {rc=0} 10:34:36.127782 --- ParallelTerminationStrategy: PID 26896 died... 10:34:36.147598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26896): Terminated: ok {rc=0} 10:34:36.236557 bus /gobi_4: Setting Powered False 10:34:37.336591 bus /gobi_4: Setting Powered False 10:34:38.454511 bus /gobi_1: Setting Powered False 10:34:39.554212 bus /gobi_1: Setting Powered False 10:34:40.673801 bus /gobi_0: Setting Powered False 10:34:41.773559 bus /gobi_0: Setting Powered False 10:34:42.890693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:34:43.997271 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.009658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:34:44.065164 tst ping.py: using LAC 20864 10:34:44.191168 tst ping.py: using RAC 209 10:34:44.310356 tst ping.py: using CellId 20864 10:34:44.434574 tst ping.py: using BVCI 20865 10:34:44.544403 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.556166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.567339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.578464 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.589950 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.601080 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.612175 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:44.623212 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:44.737905 tst ping.py:19: start network... 10:34:44.934880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:45.394411 run create_hlr_db(pid=26898): Launched 10:34:45.517797 bus /gobi_6: Setting Powered False 10:34:46.576329 run create_hlr_db(pid=26898): Terminated: ok {rc=0} 10:34:47.001744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Launched 10:34:47.314226 run osmo-hlr_10.42.42.2(pid=26901): Launched 10:34:47.430342 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:47.962229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Launched 10:34:48.260234 run osmo-stp_10.42.42.5(pid=26904): Launched 10:34:48.374184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:48.889679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26906): Launched 10:34:49.004330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:49.256370 run patchelf(pid=26907): Launched 10:34:49.423856 run osmo-stp_10.42.42.5(pid=26904): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] 10:34:49.550057 run osmo-stp_10.42.42.5(pid=26904): stdout: | (launched: 2022-12-09_10:34:48.204870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:49.677558 run osmo-stp_10.42.42.5(pid=26904): stderr: | 20221209103448369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103448369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103448370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103448370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103448371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103448371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103448371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:49.805374 run osmo-stp_10.42.42.5(pid=26904): stdout: | (launched: 2022-12-09_10:34:48.204870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:49.927793 run osmo-stp_10.42.42.5(pid=26904): stderr: | 20221209103448369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103448369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103448370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103448370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103448371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103448371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103448371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:50.072389 run patchelf(pid=26907): Terminating (SIGINT) 10:34:50.238994 run patchelf(pid=26907): Terminated: ok {rc=0} 10:34:50.358865 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26904): Process ended prematurely: osmo-stp_10.42.42.5(pid=26904) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:34:50.367809 tst ping.py:22: Test FAILED (6.4 sec) 10:34:50.394654 run osmo-hlr_10.42.42.2(pid=26901): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26901)] 10:34:50.442268 run osmo-hlr_10.42.42.2(pid=26901): stdout: | (launched: 2022-12-09_10:34:47.259365) 10:34:50.491691 run osmo-hlr_10.42.42.2(pid=26901): stderr: | 20221209103447430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103447430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103447430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103447430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103447430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103447430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103447442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103447450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103447450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103447450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:50.541626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Terminating (SIGTERM) 10:34:50.581479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Terminating (SIGTERM) 10:34:50.621806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26906): Terminating (SIGTERM) 10:34:50.661773 --- ParallelTerminationStrategy: PID 26900 died... 10:34:50.680807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Terminated: ok {rc=0} 10:34:50.724906 --- ParallelTerminationStrategy: PID 26903 died... 10:34:50.743643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Terminated: ok {rc=0} 10:34:50.787399 --- ParallelTerminationStrategy: PID 26906 died... 10:34:50.806264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26906): Terminated: ok {rc=0} 10:34:50.892397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:34:51.982418 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:51.994380 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:34:52.047614 tst ping_idle_ping.py: using LAC 20865 10:34:52.165827 tst ping_idle_ping.py: using RAC 210 10:34:52.284893 tst ping_idle_ping.py: using CellId 20865 10:34:52.401788 tst ping_idle_ping.py: using BVCI 20866 10:34:52.509262 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.520674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.531911 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.543240 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.554504 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.566076 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.577418 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:34:52.588550 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:34:52.703781 tst ping_idle_ping.py:24: start network... 10:34:52.901170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:53.367426 run create_hlr_db(pid=26908): Launched 10:34:53.490816 bus /gobi_6: Setting Powered False 10:34:54.550512 run create_hlr_db(pid=26908): Terminated: ok {rc=0} 10:34:54.968367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Launched 10:34:55.268906 run osmo-hlr_10.42.42.2(pid=26911): Launched 10:34:55.382776 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:55.914157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Launched 10:34:56.211856 run osmo-stp_10.42.42.5(pid=26914): Launched 10:34:56.324758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:56.840552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26916): Launched 10:34:56.954894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:57.205964 run patchelf(pid=26917): Launched 10:34:57.372562 run osmo-stp_10.42.42.5(pid=26914): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] 10:34:57.499604 run osmo-stp_10.42.42.5(pid=26914): stdout: | (launched: 2022-12-09_10:34:56.157251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:57.627728 run osmo-stp_10.42.42.5(pid=26914): stderr: | 20221209103456321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103456321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103456321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103456322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103456322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103456322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103456322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:57.755693 run osmo-stp_10.42.42.5(pid=26914): stdout: | (launched: 2022-12-09_10:34:56.157251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:57.878568 run osmo-stp_10.42.42.5(pid=26914): stderr: | 20221209103456321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103456321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103456321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103456322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103456322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103456322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103456322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:58.023569 run patchelf(pid=26917): Terminating (SIGINT) 10:34:58.191158 run patchelf(pid=26917): Terminated: ok {rc=0} 10:34:58.311098 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26914): Process ended prematurely: osmo-stp_10.42.42.5(pid=26914) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:34:58.320050 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:34:58.347085 run osmo-hlr_10.42.42.2(pid=26911): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26911)] 10:34:58.395156 run osmo-hlr_10.42.42.2(pid=26911): stdout: | (launched: 2022-12-09_10:34:55.213204) 10:34:58.444727 run osmo-hlr_10.42.42.2(pid=26911): stderr: | 20221209103455387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103455387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103455387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103455387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103455387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103455387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103455400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103455409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103455410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103455410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:58.494806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Terminating (SIGTERM) 10:34:58.534935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Terminating (SIGTERM) 10:34:58.575127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26916): Terminating (SIGTERM) 10:34:58.615349 --- ParallelTerminationStrategy: PID 26910 died... 10:34:58.634624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Terminated: ok {rc=0} 10:34:58.678734 --- ParallelTerminationStrategy: PID 26913 died... 10:34:58.697566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Terminated: ok {rc=0} 10:34:58.741430 --- ParallelTerminationStrategy: PID 26916 died... 10:34:58.760154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26916): Terminated: ok {rc=0} 10:34:58.845966 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:35:00.156380 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:00.163100 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:35:00.195144 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:35:00.229475 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:35:00.283379 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:35:00.316229 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:35:00.350142 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:35:00.925101 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:35:00.930333 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:00.941803 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:35:01.011721 tst switch_tch_pdch.py: using LAC 20866 10:35:01.129382 tst switch_tch_pdch.py: using RAC 211 10:35:01.298728 tst switch_tch_pdch.py: using CellId 20866 10:35:01.450146 tst switch_tch_pdch.py: using BVCI 20867 10:35:01.569562 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.582503 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.596019 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.608609 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.621177 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.635338 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.650406 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:35:01.663473 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:01.804676 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:01.958869 tst switch_tch_pdch.py:51: start network... 10:35:02.166815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:02.666742 run create_hlr_db(pid=26925): Launched 10:35:02.792240 bus /gobi_6: Setting Powered False 10:35:03.855788 run create_hlr_db(pid=26925): Terminated: ok {rc=0} 10:35:04.289981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Launched 10:35:04.611316 run osmo-hlr_10.42.42.2(pid=26928): Launched 10:35:04.733654 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:05.284164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Launched 10:35:05.603026 run osmo-stp_10.42.42.5(pid=26931): Launched 10:35:05.724544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:06.273731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26933): Launched 10:35:06.397454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:06.667699 run patchelf(pid=26934): Launched 10:35:06.845185 run osmo-stp_10.42.42.5(pid=26931): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] 10:35:06.980247 run osmo-stp_10.42.42.5(pid=26931): stdout: | (launched: 2022-12-09_10:35:05.544462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:07.116820 run osmo-stp_10.42.42.5(pid=26931): stderr: | 20221209103505730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103505730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103505731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103505731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103505732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103505732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103505732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:07.253624 run osmo-stp_10.42.42.5(pid=26931): stdout: | (launched: 2022-12-09_10:35:05.544462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:07.384038 run osmo-stp_10.42.42.5(pid=26931): stderr: | 20221209103505730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103505730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103505731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103505731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103505732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103505732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103505732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:07.539281 run patchelf(pid=26934): Terminating (SIGINT) 10:35:07.717303 run patchelf(pid=26934): Terminated: ok {rc=0} 10:35:07.845961 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26931): Process ended prematurely: osmo-stp_10.42.42.5(pid=26931) [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:35:07.855651 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:35:07.884490 run osmo-hlr_10.42.42.2(pid=26928): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26928)] 10:35:07.935168 run osmo-hlr_10.42.42.2(pid=26928): stdout: | (launched: 2022-12-09_10:35:04.552551) 10:35:07.987849 run osmo-hlr_10.42.42.2(pid=26928): stderr: | 20221209103504745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103504745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103504745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103504745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103504745 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103504745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103504757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103504766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103504766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103504766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:08.041327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Terminating (SIGTERM) 10:35:08.083676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Terminating (SIGTERM) 10:35:08.126426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26933): Terminating (SIGTERM) 10:35:08.169103 --- ParallelTerminationStrategy: PID 26927 died... 10:35:08.189160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Terminated: ok {rc=0} 10:35:08.236282 --- ParallelTerminationStrategy: PID 26930 died... 10:35:08.256004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Terminated: ok {rc=0} 10:35:08.303017 --- ParallelTerminationStrategy: PID 26933 died... 10:35:08.322703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26933): Terminated: ok {rc=0} 10:35:08.410977 bus /gobi_0: Setting Powered False 10:35:09.511516 bus /gobi_0: Setting Powered False 10:35:10.629294 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:35:11.883705 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:11.890005 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:35:11.922612 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:35:11.956733 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:35:12.009956 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:35:12.043154 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:35:12.077189 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:35:12.629938 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:35:12.635116 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:12.646168 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:35:12.714347 tst switch_tch_pdch.py: using LAC 20867 10:35:12.833934 tst switch_tch_pdch.py: using RAC 212 10:35:12.959051 tst switch_tch_pdch.py: using CellId 20867 10:35:13.090122 tst switch_tch_pdch.py: using BVCI 20868 10:35:13.197778 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.208744 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.219466 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.230358 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.241160 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.251981 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.262981 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:35:13.273633 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:35:13.391743 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:35:13.513534 tst switch_tch_pdch.py:51: start network... 10:35:13.726613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:14.193171 run create_hlr_db(pid=26938): Launched 10:35:14.314978 bus /gobi_6: Setting Powered False 10:35:15.378012 run create_hlr_db(pid=26938): Terminated: ok {rc=0} 10:35:15.778452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26940): Launched 10:35:16.098243 run osmo-hlr_10.42.42.2(pid=26941): Launched 10:35:16.411871 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:16.967662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26943): Launched 10:35:17.292009 run osmo-stp_10.42.42.5(pid=26944): Launched 10:35:17.429292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:17.919587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26946): Launched 10:35:18.033885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:18.284760 run patchelf(pid=26947): Launched 10:35:18.450939 run osmo-stp_10.42.42.5(pid=26944): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26944)] 10:35:18.576865 run osmo-stp_10.42.42.5(pid=26944): stdout: | (launched: 2022-12-09_10:35:17.231327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:18.704070 run osmo-stp_10.42.42.5(pid=26944): stderr: | 20221209103517408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103517408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103517408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103517409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103517409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103517409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103517409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:18.832081 run osmo-stp_10.42.42.5(pid=26944): stdout: | (launched: 2022-12-09_10:35:17.231327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:18.954178 run osmo-stp_10.42.42.5(pid=26944): stderr: | 20221209103517408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103517408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103517408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103517409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103517409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103517409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103517409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:19.099044 run patchelf(pid=26947): Terminating (SIGINT) 10:35:19.265471 run patchelf(pid=26947): Terminated: ok {rc=0} 10:35:19.384922 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26944): Process ended prematurely: osmo-stp_10.42.42.5(pid=26944) [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26944)] [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:35:19.394018 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:35:19.420536 run osmo-hlr_10.42.42.2(pid=26941): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26941)] 10:35:19.468451 run osmo-hlr_10.42.42.2(pid=26941): stdout: | (launched: 2022-12-09_10:35:16.040091) 10:35:19.517918 run osmo-hlr_10.42.42.2(pid=26941): stderr: | 20221209103516281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103516281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103516281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103516281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103516281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103516282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103516299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103516329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103516329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103516329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:19.567898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26940): Terminating (SIGTERM) 10:35:19.608284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26943): Terminating (SIGTERM) 10:35:19.648365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26946): Terminating (SIGTERM) 10:35:19.688550 --- ParallelTerminationStrategy: PID 26940 died... 10:35:19.707739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26940): Terminated: ok {rc=0} 10:35:19.751909 --- ParallelTerminationStrategy: PID 26943 died... 10:35:19.770602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26943): Terminated: ok {rc=0} 10:35:19.814194 --- ParallelTerminationStrategy: PID 26946 died... 10:35:19.832996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26946): Terminated: ok {rc=0} 10:35:19.919342 bus /gobi_0: Setting Powered False 10:35:21.020172 bus /gobi_0: Setting Powered False 10:35:22.134591 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:trx-lms --------------------------------------------------------------------- 10:35:23.380786 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:23.384615 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:35:23.417643 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:35:23.424390 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:35:23.475538 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:35:23.507775 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:35:23.514487 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:35:24.052124 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:35:24.057369 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 10:35:24.068014 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 10:35:24.115014 tst mo_mt_sms.py: using LAC 20868 10:35:24.236588 tst mo_mt_sms.py: using RAC 213 10:35:24.352717 tst mo_mt_sms.py: using CellId 20868 10:35:24.467082 tst mo_mt_sms.py: using BVCI 20869 10:35:24.574057 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:35:24.692531 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:35:24.806617 tst mo_mt_sms.py:9: start nitb and bts... 10:35:25.005556 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:35:25.612909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26951): Launched 10:35:25.910644 run osmo-nitb_10.42.42.2(pid=26952): Launched 10:35:26.076360 run osmo-nitb_10.42.42.2(pid=26952): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26952)] 10:35:26.210100 run osmo-nitb_10.42.42.2(pid=26952): stdout: | (launched: 2022-12-09_10:35:25.856104) 10:35:26.345302 run osmo-nitb_10.42.42.2(pid=26952): stderr: | (launched: 2022-12-09_10:35:25.900316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:35:26.479865 run osmo-nitb_10.42.42.2(pid=26952): stdout: | (launched: 2022-12-09_10:35:25.856104) 10:35:26.610063 run osmo-nitb_10.42.42.2(pid=26952): stderr: | (launched: 2022-12-09_10:35:25.900316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26952): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26952) [trial-2358↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26952)] 10:35:27.023569 tst osmo-nitb_10.42.42.2(pid=26952): stdout: | (launched: 2022-12-09_10:35:25.856104) 10:35:27.143534 tst osmo-nitb_10.42.42.2(pid=26952): stderr: | (launched: 2022-12-09_10:35:25.900316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:35:27.284681 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26952): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26952) [trial-2358↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26952)] [trial-2358↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 10:35:27.293213 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 10:35:27.299873 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26951): Terminating (SIGTERM) 10:35:27.508738 --- ParallelTerminationStrategy: PID 26951 died... 10:35:27.530884 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26951): Terminated: ok {rc=0} 10:35:27.617038 bus /sierra_3: Setting Powered False 10:35:28.717419 bus /sierra_3: Setting Powered False 10:35:29.835442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:trx-lms --------------------------------------------------------------------- 10:35:31.057115 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:31.064202 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:35:31.105103 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:35:31.138189 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:35:31.196265 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:35:31.235618 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:35:31.265291 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:35:31.843015 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:35:31.848773 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:31.860066 tst sms:trx-lms: Using 1 x bts (candidates: 1) 10:35:31.908465 tst mo_mt_sms.py: using LAC 20869 10:35:32.034181 tst mo_mt_sms.py: using RAC 214 10:35:32.179653 tst mo_mt_sms.py: using CellId 20869 10:35:32.312742 tst mo_mt_sms.py: using BVCI 20870 10:35:32.421068 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:32.431655 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:32.442230 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:32.452603 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:32.463112 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:32.473700 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:35:32.590344 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:35:32.711563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:33.206134 run create_hlr_db(pid=26956): Launched 10:35:33.329512 bus /sierra_2: Setting Powered False 10:35:34.392298 run create_hlr_db(pid=26956): Terminated: ok {rc=0} 10:35:34.817885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26958): Launched 10:35:35.116752 run osmo-hlr_10.42.42.2(pid=26959): Launched 10:35:35.230745 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:35.746578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26961): Launched 10:35:36.043912 run osmo-stp_10.42.42.5(pid=26962): Launched 10:35:36.158313 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:36.697680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26964): Launched 10:35:36.997824 run osmo-msc_10.42.42.6(pid=26965): Launched 10:35:37.164478 run osmo-stp_10.42.42.5(pid=26962): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26962)] 10:35:37.290176 run osmo-stp_10.42.42.5(pid=26962): stdout: | (launched: 2022-12-09_10:35:35.989294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:37.416320 run osmo-stp_10.42.42.5(pid=26962): stderr: | 20221209103536154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103536154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103536154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103536155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103536155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103536155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103536156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:37.540345 run osmo-stp_10.42.42.5(pid=26962): stdout: | (launched: 2022-12-09_10:35:35.989294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:37.658572 run osmo-stp_10.42.42.5(pid=26962): stderr: | 20221209103536154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103536154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103536154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103536155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103536155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103536155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103536156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:37.800868 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26962): Process ended prematurely: osmo-stp_10.42.42.5(pid=26962) [trial-2358↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26962)] [trial-2358↪sms:trx-lms↪mo_mt_sms.py:16] 10:35:37.809405 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 10:35:37.835634 run osmo-hlr_10.42.42.2(pid=26959): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26959)] 10:35:37.883620 run osmo-hlr_10.42.42.2(pid=26959): stdout: | (launched: 2022-12-09_10:35:35.062162) 10:35:37.933161 run osmo-hlr_10.42.42.2(pid=26959): stderr: | 20221209103535234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103535234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103535234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103535234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103535234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103535235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103535247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103535256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103535256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103535256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:38.001822 run osmo-msc_10.42.42.6(pid=26965): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26965)] 10:35:38.049337 run osmo-msc_10.42.42.6(pid=26965): stdout: | (launched: 2022-12-09_10:35:36.942348) 10:35:38.098597 run osmo-msc_10.42.42.6(pid=26965): stderr: | 20221209103537211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103537211 DLGLOBAL DEBUG validating counter group 0x7fe1a3e97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103537211 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103537211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103537211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103537211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103537214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103537215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103537215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103537215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:38.148343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26958): Terminating (SIGTERM) 10:35:38.188015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26961): Terminating (SIGTERM) 10:35:38.227598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26964): Terminating (SIGTERM) 10:35:38.267691 --- ParallelTerminationStrategy: PID 26958 died... 10:35:38.286878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26958): Terminated: ok {rc=0} 10:35:38.330883 --- ParallelTerminationStrategy: PID 26961 died... 10:35:38.349556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26961): Terminated: ok {rc=0} 10:35:38.393201 --- ParallelTerminationStrategy: PID 26964 died... 10:35:38.411524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26964): Terminated: ok {rc=0} 10:35:38.495081 bus /sierra_3: Setting Powered False 10:35:39.594727 bus /sierra_3: Setting Powered False 10:35:40.713163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-lms --------------------------------------------------------------------- 10:35:41.946643 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:41.950916 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:35:41.985325 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:35:41.992380 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:35:42.029615 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:35:42.063974 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:35:42.070967 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:35:42.586602 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 10:35:42.591774 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 10:35:42.602663 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 10:35:42.652941 tst assert_extension.py: using LAC 20870 10:35:42.770245 tst assert_extension.py: using RAC 215 10:35:42.885405 tst assert_extension.py: using CellId 20870 10:35:43.011030 tst assert_extension.py: using BVCI 20871 10:35:43.129324 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 10:35:43.245233 tst assert_extension.py:10: start nitb and bts... 10:35:43.443384 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:35:44.055145 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26970): Launched 10:35:44.353240 run osmo-nitb_10.42.42.2(pid=26971): Launched 10:35:44.519400 run osmo-nitb_10.42.42.2(pid=26971): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26971)] 10:35:44.653491 run osmo-nitb_10.42.42.2(pid=26971): stdout: | (launched: 2022-12-09_10:35:44.298259) 10:35:44.788527 run osmo-nitb_10.42.42.2(pid=26971): stderr: | (launched: 2022-12-09_10:35:44.342806) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:35:44.923846 run osmo-nitb_10.42.42.2(pid=26971): stdout: | (launched: 2022-12-09_10:35:44.298259) 10:35:45.053783 run osmo-nitb_10.42.42.2(pid=26971): stderr: | (launched: 2022-12-09_10:35:44.342806) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26971): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26971) [trial-2358↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26971)] 10:35:45.466969 tst osmo-nitb_10.42.42.2(pid=26971): stdout: | (launched: 2022-12-09_10:35:44.298259) 10:35:45.587247 tst osmo-nitb_10.42.42.2(pid=26971): stderr: | (launched: 2022-12-09_10:35:44.342806) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:35:45.728878 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26971): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26971) [trial-2358↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26971)] [trial-2358↪nitb_ussd:trx-lms↪assert_extension.py:12] 10:35:45.737818 tst assert_extension.py:12: Test FAILED (3.1 sec) 10:35:45.744655 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26970): Terminating (SIGTERM) 10:35:45.953642 --- ParallelTerminationStrategy: PID 26970 died... 10:35:45.974953 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26970): Terminated: ok {rc=0} 10:35:46.062239 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:trx-lms --------------------------------------------------------------------- 10:35:47.239853 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:47.244353 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:35:47.278684 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:35:47.305124 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:35:47.340310 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:35:47.373938 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:35:47.401132 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:35:47.931679 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:trx-lms assert_extension.py ---------------------------------------------- 10:35:47.937779 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:47.949204 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 10:35:47.997997 tst assert_extension.py: using LAC 20871 10:35:48.124067 tst assert_extension.py: using RAC 216 10:35:48.248191 tst assert_extension.py: using CellId 20871 10:35:48.374869 tst assert_extension.py: using BVCI 20872 10:35:48.490776 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:48.501759 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:48.512527 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:48.523664 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:48.534780 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:35:48.545880 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 10:35:48.660574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:49.121204 run create_hlr_db(pid=26975): Launched 10:35:49.245117 bus /sierra_2: Setting Powered False 10:35:50.304892 run create_hlr_db(pid=26975): Terminated: ok {rc=0} 10:35:50.722603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26977): Launched 10:35:51.021536 run osmo-hlr_10.42.42.2(pid=26978): Launched 10:35:51.135259 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:51.667943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26980): Launched 10:35:51.968251 run osmo-stp_10.42.42.5(pid=26981): Launched 10:35:52.082419 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:52.621158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26983): Launched 10:35:52.919725 run osmo-msc_10.42.42.6(pid=26984): Launched 10:35:53.086783 run osmo-stp_10.42.42.5(pid=26981): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26981)] 10:35:53.212609 run osmo-stp_10.42.42.5(pid=26981): stdout: | (launched: 2022-12-09_10:35:51.913119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:53.338564 run osmo-stp_10.42.42.5(pid=26981): stderr: | 20221209103552081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103552081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103552081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103552082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103552082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103552082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103552082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:53.463071 run osmo-stp_10.42.42.5(pid=26981): stdout: | (launched: 2022-12-09_10:35:51.913119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:53.582132 run osmo-stp_10.42.42.5(pid=26981): stderr: | 20221209103552081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103552081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103552081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103552082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103552082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103552082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103552082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:53.724107 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26981): Process ended prematurely: osmo-stp_10.42.42.5(pid=26981) [trial-2358↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26981)] [trial-2358↪ussd:trx-lms↪assert_extension.py:17] 10:35:53.732660 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:35:53.759470 run osmo-hlr_10.42.42.2(pid=26978): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26978)] 10:35:53.808055 run osmo-hlr_10.42.42.2(pid=26978): stdout: | (launched: 2022-12-09_10:35:50.966590) 10:35:53.858561 run osmo-hlr_10.42.42.2(pid=26978): stderr: | 20221209103551137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103551137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103551137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103551137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103551137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103551138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103551149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103551157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103551157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103551157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:53.928935 run osmo-msc_10.42.42.6(pid=26984): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26984)] 10:35:53.977396 run osmo-msc_10.42.42.6(pid=26984): stdout: | (launched: 2022-12-09_10:35:52.864779) 10:35:54.027437 run osmo-msc_10.42.42.6(pid=26984): stderr: | 20221209103553132 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103553132 DLGLOBAL DEBUG validating counter group 0x7f2cf1383c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103553132 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103553132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103553132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103553132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103553134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103553134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103553135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103553135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:54.077546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26977): Terminating (SIGTERM) 10:35:54.117786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26980): Terminating (SIGTERM) 10:35:54.157948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26983): Terminating (SIGTERM) 10:35:54.198331 --- ParallelTerminationStrategy: PID 26977 died... 10:35:54.217674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26977): Terminated: ok {rc=0} 10:35:54.262183 --- ParallelTerminationStrategy: PID 26980 died... 10:35:54.280687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26980): Terminated: ok {rc=0} 10:35:54.324821 --- ParallelTerminationStrategy: PID 26983 died... 10:35:54.343994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26983): Terminated: ok {rc=0} 10:35:54.428005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:35:55.642748 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:55.650715 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:35:55.683385 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:35:55.709766 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:35:55.762583 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:35:55.795638 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:35:55.821912 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:35:56.370316 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:35:56.419478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:35:56.430715 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:35:56.499498 tst mo_mt_call.py: using LAC 20872 10:35:56.625652 tst mo_mt_call.py: using RAC 217 10:35:56.753374 tst mo_mt_call.py: using CellId 20872 10:35:56.879693 tst mo_mt_call.py: using BVCI 20873 10:35:56.990318 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:35:57.004694 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:35:57.016507 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:35:57.028140 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:35:57.039937 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:35:57.051681 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:35:57.168134 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:35:57.287417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:57.793963 run create_hlr_db(pid=26989): Launched 10:35:57.919564 bus /sierra_2: Setting Powered False 10:35:58.984415 run create_hlr_db(pid=26989): Terminated: ok {rc=0} 10:35:59.436704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26991): Launched 10:35:59.761423 run osmo-hlr_10.42.42.2(pid=26992): Launched 10:35:59.886442 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:00.452103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26994): Launched 10:36:00.776094 run osmo-stp_10.42.42.5(pid=26995): Launched 10:36:00.961916 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:01.644859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26997): Launched 10:36:01.977094 run osmo-msc_10.42.42.6(pid=26998): Launched 10:36:02.205447 run osmo-stp_10.42.42.5(pid=26995): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26995)] 10:36:02.395784 run osmo-stp_10.42.42.5(pid=26995): stdout: | (launched: 2022-12-09_10:36:00.717378) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:02.547249 run osmo-stp_10.42.42.5(pid=26995): stderr: | 20221209103600981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103600981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103600981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103600982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103600982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103600982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103600982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:02.683368 run osmo-stp_10.42.42.5(pid=26995): stdout: | (launched: 2022-12-09_10:36:00.717378) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:02.813193 run osmo-stp_10.42.42.5(pid=26995): stderr: | 20221209103600981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103600981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103600981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103600982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103600982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103600982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103600982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:02.967988 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26995): Process ended prematurely: osmo-stp_10.42.42.5(pid=26995) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26995)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:36:02.977969 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:36:03.006641 run osmo-hlr_10.42.42.2(pid=26992): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26992)] 10:36:03.057642 run osmo-hlr_10.42.42.2(pid=26992): stdout: | (launched: 2022-12-09_10:35:59.702353) 10:36:03.110368 run osmo-hlr_10.42.42.2(pid=26992): stderr: | 20221209103559897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103559898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103559898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103559898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103559898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103559898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103559911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103559921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103559922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103559922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:03.183964 run osmo-msc_10.42.42.6(pid=26998): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26998)] 10:36:03.234870 run osmo-msc_10.42.42.6(pid=26998): stdout: | (launched: 2022-12-09_10:36:01.918036) 10:36:03.287564 run osmo-msc_10.42.42.6(pid=26998): stderr: | 20221209103602477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103602477 DLGLOBAL DEBUG validating counter group 0x7f7640bcbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103602478 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103602478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103602478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103602478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103602480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103602480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103602480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103602480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:03.340718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26991): Terminating (SIGTERM) 10:36:03.383221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26994): Terminating (SIGTERM) 10:36:03.426148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26997): Terminating (SIGTERM) 10:36:03.469063 --- ParallelTerminationStrategy: PID 26991 died... 10:36:03.489350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26991): Terminated: ok {rc=0} 10:36:03.536737 --- ParallelTerminationStrategy: PID 26994 died... 10:36:03.556611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26994): Terminated: ok {rc=0} 10:36:03.604045 --- ParallelTerminationStrategy: PID 26997 died... 10:36:03.624046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26997): Terminated: ok {rc=0} 10:36:03.713504 bus /sierra_3: Setting Powered False 10:36:04.810829 bus /sierra_3: Setting Powered False 10:36:05.927014 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:36:07.074864 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:36:07.086662 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:36:07.156214 tst mo_mt_call_osmux.py: using LAC 20873 10:36:07.274910 tst mo_mt_call_osmux.py: using RAC 218 10:36:07.403639 tst mo_mt_call_osmux.py: using CellId 20873 10:36:07.525075 tst mo_mt_call_osmux.py: using BVCI 20874 10:36:07.634783 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:36:07.646059 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:36:07.657151 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:36:07.668249 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:36:07.679264 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:36:07.690058 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:36:07.809336 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:36:07.930332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:08.403069 run create_hlr_db(pid=27000): Launched 10:36:08.528395 bus /sierra_2: Setting Powered False 10:36:09.588595 run create_hlr_db(pid=27000): Terminated: ok {rc=0} 10:36:10.033135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27002): Launched 10:36:10.359481 run osmo-hlr_10.42.42.2(pid=27003): Launched 10:36:10.484387 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:11.051918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27005): Launched 10:36:11.378234 run osmo-stp_10.42.42.5(pid=27006): Launched 10:36:11.503934 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:12.094672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27008): Launched 10:36:12.423882 run osmo-msc_10.42.42.6(pid=27009): Launched 10:36:12.606593 run osmo-stp_10.42.42.5(pid=27006): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27006)] 10:36:12.744192 run osmo-stp_10.42.42.5(pid=27006): stdout: | (launched: 2022-12-09_10:36:11.319182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:12.881961 run osmo-stp_10.42.42.5(pid=27006): stderr: | 20221209103611507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103611507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103611507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103611507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103611508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103611508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103611508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:13.017823 run osmo-stp_10.42.42.5(pid=27006): stdout: | (launched: 2022-12-09_10:36:11.319182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:13.147952 run osmo-stp_10.42.42.5(pid=27006): stderr: | 20221209103611507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103611507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103611507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103611507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103611508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103611508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103611508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:13.304011 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27006): Process ended prematurely: osmo-stp_10.42.42.5(pid=27006) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27006)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:36:13.313995 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:36:13.343247 run osmo-hlr_10.42.42.2(pid=27003): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27003)] 10:36:13.394539 run osmo-hlr_10.42.42.2(pid=27003): stdout: | (launched: 2022-12-09_10:36:10.300265) 10:36:13.447596 run osmo-hlr_10.42.42.2(pid=27003): stderr: | 20221209103610494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103610494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103610494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103610494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103610494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103610494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103610506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103610515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103610515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103610516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:13.521109 run osmo-msc_10.42.42.6(pid=27009): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27009)] 10:36:13.572114 run osmo-msc_10.42.42.6(pid=27009): stdout: | (launched: 2022-12-09_10:36:12.364590) 10:36:13.624754 run osmo-msc_10.42.42.6(pid=27009): stderr: | 20221209103612683 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103612683 DLGLOBAL DEBUG validating counter group 0x7ffacf3e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103612683 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103612683 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103612683 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103612683 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103612685 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103612686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103612686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103612686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:13.678107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27002): Terminating (SIGTERM) 10:36:13.720990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27005): Terminating (SIGTERM) 10:36:13.764434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27008): Terminating (SIGTERM) 10:36:13.807656 --- ParallelTerminationStrategy: PID 27002 died... 10:36:13.828010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27002): Terminated: ok {rc=0} 10:36:13.875854 --- ParallelTerminationStrategy: PID 27005 died... 10:36:13.895840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27005): Terminated: ok {rc=0} 10:36:13.943054 --- ParallelTerminationStrategy: PID 27008 died... 10:36:13.962802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27008): Terminated: ok {rc=0} 10:36:14.052419 bus /sierra_3: Setting Powered False 10:36:15.152117 bus /sierra_3: Setting Powered False 10:36:16.271514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:36:17.527884 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:36:17.534951 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:36:17.569559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:36:17.597014 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:36:17.651724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:36:17.685970 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:36:17.713566 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:36:18.265551 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:36:18.317850 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:18.329396 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:36:18.398638 tst mo_mt_call.py: using LAC 20874 10:36:18.525464 tst mo_mt_call.py: using RAC 219 10:36:18.652900 tst mo_mt_call.py: using CellId 20874 10:36:18.779005 tst mo_mt_call.py: using BVCI 20875 10:36:18.898890 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:18.910378 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:18.921755 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:18.933312 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:18.944821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:18.956397 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:36:19.075289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:36:19.194758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:19.700041 run create_hlr_db(pid=27015): Launched 10:36:19.824360 bus /sierra_2: Setting Powered False 10:36:20.888750 run create_hlr_db(pid=27015): Terminated: ok {rc=0} 10:36:21.324555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Launched 10:36:21.630043 run osmo-hlr_10.42.42.2(pid=27018): Launched 10:36:21.746425 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:22.291760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Launched 10:36:22.595571 run osmo-stp_10.42.42.5(pid=27021): Launched 10:36:22.712535 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:23.261465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27023): Launched 10:36:23.566882 run osmo-msc_10.42.42.6(pid=27024): Launched 10:36:23.737557 run osmo-stp_10.42.42.5(pid=27021): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] 10:36:23.865816 run osmo-stp_10.42.42.5(pid=27021): stdout: | (launched: 2022-12-09_10:36:22.539803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:23.994303 run osmo-stp_10.42.42.5(pid=27021): stderr: | 20221209103622707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103622707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103622707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103622708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103622708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103622708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103622708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:24.122025 run osmo-stp_10.42.42.5(pid=27021): stdout: | (launched: 2022-12-09_10:36:22.539803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:24.243648 run osmo-stp_10.42.42.5(pid=27021): stderr: | 20221209103622707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103622707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103622707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103622708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103622708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103622708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103622708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:24.388499 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27021): Process ended prematurely: osmo-stp_10.42.42.5(pid=27021) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:36:24.397762 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:36:24.424623 run osmo-hlr_10.42.42.2(pid=27018): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27018)] 10:36:24.472593 run osmo-hlr_10.42.42.2(pid=27018): stdout: | (launched: 2022-12-09_10:36:21.574328) 10:36:24.522551 run osmo-hlr_10.42.42.2(pid=27018): stderr: | 20221209103621746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103621746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103621746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103621746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103621746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103621746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103621758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103621767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103621767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103621768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:24.591872 run osmo-msc_10.42.42.6(pid=27024): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27024)] 10:36:24.639616 run osmo-msc_10.42.42.6(pid=27024): stdout: | (launched: 2022-12-09_10:36:23.511009) 10:36:24.689353 run osmo-msc_10.42.42.6(pid=27024): stderr: | 20221209103623779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103623779 DLGLOBAL DEBUG validating counter group 0x7f5365c9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103623779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103623780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103623780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103623780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103623782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103623782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103623782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103623782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:24.739485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Terminating (SIGTERM) 10:36:24.779387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Terminating (SIGTERM) 10:36:24.819559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27023): Terminating (SIGTERM) 10:36:24.859989 --- ParallelTerminationStrategy: PID 27017 died... 10:36:24.879288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Terminated: ok {rc=0} 10:36:24.923711 --- ParallelTerminationStrategy: PID 27020 died... 10:36:24.942556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Terminated: ok {rc=0} 10:36:24.986952 --- ParallelTerminationStrategy: PID 27023 died... 10:36:25.005649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27023): Terminated: ok {rc=0} 10:36:25.090470 bus /sierra_3: Setting Powered False 10:36:26.188680 bus /sierra_3: Setting Powered False 10:36:27.305289 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:36:28.453269 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:28.465124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:36:28.534977 tst mo_mt_call_osmux.py: using LAC 20875 10:36:28.653887 tst mo_mt_call_osmux.py: using RAC 220 10:36:28.777723 tst mo_mt_call_osmux.py: using CellId 20875 10:36:28.906336 tst mo_mt_call_osmux.py: using BVCI 20876 10:36:29.026931 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:29.038674 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:29.050322 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:29.062711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:29.075747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:36:29.087256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:36:29.209400 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:36:29.329947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:29.835559 run create_hlr_db(pid=27026): Launched 10:36:29.960013 bus /sierra_2: Setting Powered False 10:36:31.023523 run create_hlr_db(pid=27026): Terminated: ok {rc=0} 10:36:31.487195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27028): Launched 10:36:31.830331 run osmo-hlr_10.42.42.2(pid=27029): Launched 10:36:32.080063 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:32.613422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27031): Launched 10:36:32.918699 run osmo-stp_10.42.42.5(pid=27032): Launched 10:36:33.033777 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:33.583427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27034): Launched 10:36:33.887473 run osmo-msc_10.42.42.6(pid=27035): Launched 10:36:34.056598 run osmo-stp_10.42.42.5(pid=27032): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27032)] 10:36:34.185569 run osmo-stp_10.42.42.5(pid=27032): stdout: | (launched: 2022-12-09_10:36:32.862938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:34.314014 run osmo-stp_10.42.42.5(pid=27032): stderr: | 20221209103633032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103633032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103633032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103633032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103633033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103633033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103633033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:34.440753 run osmo-stp_10.42.42.5(pid=27032): stdout: | (launched: 2022-12-09_10:36:32.862938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:34.561905 run osmo-stp_10.42.42.5(pid=27032): stderr: | 20221209103633032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103633032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103633032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103633032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103633033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103633033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103633033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:34.706976 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27032): Process ended prematurely: osmo-stp_10.42.42.5(pid=27032) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27032)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:36:34.716169 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:36:34.743358 run osmo-hlr_10.42.42.2(pid=27029): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27029)] 10:36:34.791965 run osmo-hlr_10.42.42.2(pid=27029): stdout: | (launched: 2022-12-09_10:36:31.770860) 10:36:34.842411 run osmo-hlr_10.42.42.2(pid=27029): stderr: | 20221209103632064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103632064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103632064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103632064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103632064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103632064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103632091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103632100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103632100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103632100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:34.912620 run osmo-msc_10.42.42.6(pid=27035): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27035)] 10:36:34.961028 run osmo-msc_10.42.42.6(pid=27035): stdout: | (launched: 2022-12-09_10:36:33.831095) 10:36:35.011124 run osmo-msc_10.42.42.6(pid=27035): stderr: | 20221209103634100 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103634100 DLGLOBAL DEBUG validating counter group 0x7f4254bd7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103634100 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103634100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103634101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103634101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103634103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103634103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103634103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103634103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:35.062049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27028): Terminating (SIGTERM) 10:36:35.102623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27031): Terminating (SIGTERM) 10:36:35.142993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27034): Terminating (SIGTERM) 10:36:35.183806 --- ParallelTerminationStrategy: PID 27028 died... 10:36:35.203413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27028): Terminated: ok {rc=0} 10:36:35.248547 --- ParallelTerminationStrategy: PID 27031 died... 10:36:35.267702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27031): Terminated: ok {rc=0} 10:36:35.312422 --- ParallelTerminationStrategy: PID 27034 died... 10:36:35.331929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27034): Terminated: ok {rc=0} 10:36:35.420118 bus /sierra_3: Setting Powered False 10:36:36.521382 bus /sierra_3: Setting Powered False 10:36:37.638194 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:36:38.894414 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:36:38.901700 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:36:38.936391 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:36:38.963890 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:36:39.017245 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:36:39.051008 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:36:39.078512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:36:39.629452 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:36:39.682161 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:39.693391 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:36:39.761854 tst mo_mt_call.py: using LAC 20876 10:36:39.890820 tst mo_mt_call.py: using RAC 221 10:36:40.019738 tst mo_mt_call.py: using CellId 20876 10:36:40.147044 tst mo_mt_call.py: using BVCI 20877 10:36:40.266716 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:40.278318 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:40.289699 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:40.301379 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:40.313705 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:40.325256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:36:40.442189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:36:40.563380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:41.070533 run create_hlr_db(pid=27040): Launched 10:36:41.196080 bus /sierra_2: Setting Powered False 10:36:42.261418 run create_hlr_db(pid=27040): Terminated: ok {rc=0} 10:36:42.716816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27042): Launched 10:36:43.042992 run osmo-hlr_10.42.42.2(pid=27043): Launched 10:36:43.170540 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:43.731685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27045): Launched 10:36:44.056410 run osmo-stp_10.42.42.5(pid=27046): Launched 10:36:44.181502 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:44.770234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27048): Launched 10:36:45.096202 run osmo-msc_10.42.42.6(pid=27049): Launched 10:36:45.279251 run osmo-stp_10.42.42.5(pid=27046): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27046)] 10:36:45.416622 run osmo-stp_10.42.42.5(pid=27046): stdout: | (launched: 2022-12-09_10:36:43.997576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:45.553962 run osmo-stp_10.42.42.5(pid=27046): stderr: | 20221209103644183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103644184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103644184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103644184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103644185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103644185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103644185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:45.689634 run osmo-stp_10.42.42.5(pid=27046): stdout: | (launched: 2022-12-09_10:36:43.997576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:45.819607 run osmo-stp_10.42.42.5(pid=27046): stderr: | 20221209103644183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103644184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103644184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103644184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103644185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103644185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103644185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:45.989143 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27046): Process ended prematurely: osmo-stp_10.42.42.5(pid=27046) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27046)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:36:45.999708 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:36:46.031261 run osmo-hlr_10.42.42.2(pid=27043): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27043)] 10:36:46.084206 run osmo-hlr_10.42.42.2(pid=27043): stdout: | (launched: 2022-12-09_10:36:42.983776) 10:36:46.139230 run osmo-hlr_10.42.42.2(pid=27043): stderr: | 20221209103643176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103643176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103643176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103643176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103643176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103643176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103643194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103643204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103643204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103643204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:46.215503 run osmo-msc_10.42.42.6(pid=27049): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27049)] 10:36:46.268506 run osmo-msc_10.42.42.6(pid=27049): stdout: | (launched: 2022-12-09_10:36:45.037210) 10:36:46.323230 run osmo-msc_10.42.42.6(pid=27049): stderr: | 20221209103645355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103645355 DLGLOBAL DEBUG validating counter group 0x7f8db2e61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103645355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103645355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103645355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103645355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103645357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103645358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103645358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103645358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:46.378594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27042): Terminating (SIGTERM) 10:36:46.422959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27045): Terminating (SIGTERM) 10:36:46.467543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27048): Terminating (SIGTERM) 10:36:46.512437 --- ParallelTerminationStrategy: PID 27042 died... 10:36:46.533175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27042): Terminated: ok {rc=0} 10:36:46.583201 --- ParallelTerminationStrategy: PID 27045 died... 10:36:46.603918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27045): Terminated: ok {rc=0} 10:36:46.654031 --- ParallelTerminationStrategy: PID 27048 died... 10:36:46.674874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27048): Terminated: ok {rc=0} 10:36:46.768390 bus /sierra_3: Setting Powered False 10:36:47.869686 bus /sierra_3: Setting Powered False 10:36:48.988028 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:36:50.141123 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:50.153280 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:36:50.225699 tst mo_mt_call_osmux.py: using LAC 20877 10:36:50.354293 tst mo_mt_call_osmux.py: using RAC 222 10:36:50.481314 tst mo_mt_call_osmux.py: using CellId 20877 10:36:50.608403 tst mo_mt_call_osmux.py: using BVCI 20878 10:36:50.726928 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:50.738439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:50.749875 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:50.761570 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:50.773232 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:36:50.784634 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:36:50.903957 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:36:51.023491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:51.496874 run create_hlr_db(pid=27051): Launched 10:36:51.622626 bus /sierra_2: Setting Powered False 10:36:52.683764 run create_hlr_db(pid=27051): Terminated: ok {rc=0} 10:36:53.128349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27053): Launched 10:36:53.455106 run osmo-hlr_10.42.42.2(pid=27054): Launched 10:36:53.580896 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:54.147857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27056): Launched 10:36:54.473769 run osmo-stp_10.42.42.5(pid=27057): Launched 10:36:54.598871 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:55.188722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27059): Launched 10:36:55.514819 run osmo-msc_10.42.42.6(pid=27060): Launched 10:36:55.699045 run osmo-stp_10.42.42.5(pid=27057): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27057)] 10:36:55.836355 run osmo-stp_10.42.42.5(pid=27057): stdout: | (launched: 2022-12-09_10:36:54.414623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:55.974049 run osmo-stp_10.42.42.5(pid=27057): stderr: | 20221209103654603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103654603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103654603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103654603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103654604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103654604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103654604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:56.110671 run osmo-stp_10.42.42.5(pid=27057): stdout: | (launched: 2022-12-09_10:36:54.414623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:56.241087 run osmo-stp_10.42.42.5(pid=27057): stderr: | 20221209103654603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103654603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103654603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103654603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103654604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103654604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103654604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:56.397679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27057): Process ended prematurely: osmo-stp_10.42.42.5(pid=27057) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27057)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:36:56.407630 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:36:56.436911 run osmo-hlr_10.42.42.2(pid=27054): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27054)] 10:36:56.488312 run osmo-hlr_10.42.42.2(pid=27054): stdout: | (launched: 2022-12-09_10:36:53.395869) 10:36:56.541414 run osmo-hlr_10.42.42.2(pid=27054): stderr: | 20221209103653589 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103653589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103653589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103653589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103653589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103653589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103653602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103653611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103653611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103653611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:56.615503 run osmo-msc_10.42.42.6(pid=27060): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27060)] 10:36:56.666736 run osmo-msc_10.42.42.6(pid=27060): stdout: | (launched: 2022-12-09_10:36:55.455543) 10:36:56.720284 run osmo-msc_10.42.42.6(pid=27060): stderr: | 20221209103655774 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103655774 DLGLOBAL DEBUG validating counter group 0x7f1441ec2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103655774 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103655774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103655774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103655774 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103655776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103655776 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103655777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103655777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:56.774009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27053): Terminating (SIGTERM) 10:36:56.816739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27056): Terminating (SIGTERM) 10:36:56.859532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27059): Terminating (SIGTERM) 10:36:56.902643 --- ParallelTerminationStrategy: PID 27053 died... 10:36:56.923132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27053): Terminated: ok {rc=0} 10:36:56.970872 --- ParallelTerminationStrategy: PID 27056 died... 10:36:56.990910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27056): Terminated: ok {rc=0} 10:36:57.038027 --- ParallelTerminationStrategy: PID 27059 died... 10:36:57.058050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27059): Terminated: ok {rc=0} 10:36:57.147645 bus /sierra_3: Setting Powered False 10:36:58.248054 bus /sierra_3: Setting Powered False 10:36:59.367665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:37:00.618691 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:00.625068 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:37:00.657377 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:37:00.683672 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:37:00.734734 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:37:00.767391 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:37:00.794070 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:37:01.343977 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:37:01.394660 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:01.406290 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:37:01.475520 tst mo_mt_call.py: using LAC 20878 10:37:01.597271 tst mo_mt_call.py: using RAC 223 10:37:01.729761 tst mo_mt_call.py: using CellId 20878 10:37:01.862985 tst mo_mt_call.py: using BVCI 20879 10:37:01.995198 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:02.008773 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:02.021313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:02.034947 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:02.049804 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:02.063567 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:37:02.188725 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:37:02.306807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:02.780836 run create_hlr_db(pid=27065): Launched 10:37:02.906327 bus /sierra_2: Setting Powered False 10:37:03.967586 run create_hlr_db(pid=27065): Terminated: ok {rc=0} 10:37:04.392036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27067): Launched 10:37:04.697621 run osmo-hlr_10.42.42.2(pid=27068): Launched 10:37:04.813510 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:05.338898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27070): Launched 10:37:05.644114 run osmo-stp_10.42.42.5(pid=27071): Launched 10:37:05.759484 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:06.308920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27073): Launched 10:37:06.614020 run osmo-msc_10.42.42.6(pid=27074): Launched 10:37:06.783805 run osmo-stp_10.42.42.5(pid=27071): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27071)] 10:37:06.912720 run osmo-stp_10.42.42.5(pid=27071): stdout: | (launched: 2022-12-09_10:37:05.588361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:07.041446 run osmo-stp_10.42.42.5(pid=27071): stderr: | 20221209103705757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103705757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103705757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103705758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103705758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103705758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103705758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:07.167977 run osmo-stp_10.42.42.5(pid=27071): stdout: | (launched: 2022-12-09_10:37:05.588361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:07.288806 run osmo-stp_10.42.42.5(pid=27071): stderr: | 20221209103705757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103705757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103705757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103705758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103705758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103705758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103705758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:07.433642 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27071): Process ended prematurely: osmo-stp_10.42.42.5(pid=27071) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27071)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:37:07.442562 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:37:07.469580 run osmo-hlr_10.42.42.2(pid=27068): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27068)] 10:37:07.517941 run osmo-hlr_10.42.42.2(pid=27068): stdout: | (launched: 2022-12-09_10:37:04.642008) 10:37:07.568079 run osmo-hlr_10.42.42.2(pid=27068): stderr: | 20221209103704815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103704815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103704815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103704815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103704815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103704815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103704828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103704836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103704837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103704837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:07.637981 run osmo-msc_10.42.42.6(pid=27074): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27074)] 10:37:07.686553 run osmo-msc_10.42.42.6(pid=27074): stdout: | (launched: 2022-12-09_10:37:06.557583) 10:37:07.736347 run osmo-msc_10.42.42.6(pid=27074): stderr: | 20221209103706829 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103706829 DLGLOBAL DEBUG validating counter group 0x7f8e9ca35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103706829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103706829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103706829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103706829 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103706831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103706831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103706832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103706832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:37:07.786849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27067): Terminating (SIGTERM) 10:37:07.826794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27070): Terminating (SIGTERM) 10:37:07.866672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27073): Terminating (SIGTERM) 10:37:07.906946 --- ParallelTerminationStrategy: PID 27067 died... 10:37:07.926195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27067): Terminated: ok {rc=0} 10:37:07.970398 --- ParallelTerminationStrategy: PID 27070 died... 10:37:07.989138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27070): Terminated: ok {rc=0} 10:37:08.033314 --- ParallelTerminationStrategy: PID 27073 died... 10:37:08.052171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27073): Terminated: ok {rc=0} 10:37:08.139107 bus /sierra_3: Setting Powered False 10:37:09.240489 bus /sierra_3: Setting Powered False 10:37:10.358223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:37:11.505936 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:11.517669 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:37:11.586899 tst mo_mt_call_osmux.py: using LAC 20879 10:37:11.716724 tst mo_mt_call_osmux.py: using RAC 224 10:37:11.846607 tst mo_mt_call_osmux.py: using CellId 20879 10:37:11.975173 tst mo_mt_call_osmux.py: using BVCI 20880 10:37:12.095456 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:12.107379 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:12.118891 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:12.130638 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:12.142528 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:37:12.154285 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:37:12.272103 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:37:12.392395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:12.867709 run create_hlr_db(pid=27076): Launched 10:37:12.993204 bus /sierra_2: Setting Powered False 10:37:14.054473 run create_hlr_db(pid=27076): Terminated: ok {rc=0} 10:37:14.480074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27078): Launched 10:37:14.786192 run osmo-hlr_10.42.42.2(pid=27079): Launched 10:37:14.901546 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:15.441635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27081): Launched 10:37:15.746890 run osmo-stp_10.42.42.5(pid=27082): Launched 10:37:15.915497 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:16.594545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27084): Launched 10:37:16.914703 run osmo-msc_10.42.42.6(pid=27085): Launched 10:37:17.126209 run osmo-stp_10.42.42.5(pid=27082): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27082)] 10:37:17.332564 run osmo-stp_10.42.42.5(pid=27082): stdout: | (launched: 2022-12-09_10:37:15.691009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:17.475206 run osmo-stp_10.42.42.5(pid=27082): stderr: | 20221209103715886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103715886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103715886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103715887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103715887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103715887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103715887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:17.616579 run osmo-stp_10.42.42.5(pid=27082): stdout: | (launched: 2022-12-09_10:37:15.691009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:17.749110 run osmo-stp_10.42.42.5(pid=27082): stderr: | 20221209103715886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103715886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103715886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103715887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103715887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103715887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103715887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:17.906737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27082): Process ended prematurely: osmo-stp_10.42.42.5(pid=27082) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27082)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:37:17.916856 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:37:17.947363 run osmo-hlr_10.42.42.2(pid=27079): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27079)] 10:37:17.999825 run osmo-hlr_10.42.42.2(pid=27079): stdout: | (launched: 2022-12-09_10:37:14.730480) 10:37:18.054098 run osmo-hlr_10.42.42.2(pid=27079): stderr: | 20221209103714904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103714904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103714904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103714904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103714904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103714905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103714916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103714926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103714926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103714926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:18.129148 run osmo-msc_10.42.42.6(pid=27085): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27085)] 10:37:18.181714 run osmo-msc_10.42.42.6(pid=27085): stdout: | (launched: 2022-12-09_10:37:16.857712) 10:37:18.235869 run osmo-msc_10.42.42.6(pid=27085): stderr: | 20221209103717339 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103717339 DLGLOBAL DEBUG validating counter group 0x7fc0d8fdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103717339 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103717339 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103717340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103717340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103717342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103717342 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103717342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103717342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:37:18.290399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27078): Terminating (SIGTERM) 10:37:18.334321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27081): Terminating (SIGTERM) 10:37:18.378671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27084): Terminating (SIGTERM) 10:37:18.423505 --- ParallelTerminationStrategy: PID 27078 died... 10:37:18.444260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27078): Terminated: ok {rc=0} 10:37:18.493635 --- ParallelTerminationStrategy: PID 27081 died... 10:37:18.513883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27081): Terminated: ok {rc=0} 10:37:18.563235 --- ParallelTerminationStrategy: PID 27084 died... 10:37:18.583406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27084): Terminated: ok {rc=0} 10:37:18.675262 bus /sierra_3: Setting Powered False 10:37:19.776380 bus /sierra_3: Setting Powered False 10:37:20.894545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:37:22.151075 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:22.157655 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:37:22.190783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:37:22.216921 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:37:22.266686 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:37:22.299138 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:37:22.325266 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:37:22.877605 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:37:22.926457 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:22.937597 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:37:23.004525 tst mo_mt_call.py: using LAC 20880 10:37:23.122161 tst mo_mt_call.py: using RAC 225 10:37:23.242316 tst mo_mt_call.py: using CellId 20880 10:37:23.361646 tst mo_mt_call.py: using BVCI 20881 10:37:23.471592 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:23.482573 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:23.493346 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:23.504032 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:23.514929 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:23.525734 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:37:23.643681 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:37:23.759294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:24.232733 run create_hlr_db(pid=27091): Launched 10:37:24.358010 bus /sierra_2: Setting Powered False 10:37:25.418686 run create_hlr_db(pid=27091): Terminated: ok {rc=0} 10:37:25.844742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27093): Launched 10:37:26.149433 run osmo-hlr_10.42.42.2(pid=27094): Launched 10:37:26.265843 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:26.794190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27096): Launched 10:37:27.097004 run osmo-stp_10.42.42.5(pid=27097): Launched 10:37:27.213014 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:27.763507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27099): Launched 10:37:28.066910 run osmo-msc_10.42.42.6(pid=27100): Launched 10:37:28.237429 run osmo-stp_10.42.42.5(pid=27097): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27097)] 10:37:28.365422 run osmo-stp_10.42.42.5(pid=27097): stdout: | (launched: 2022-12-09_10:37:27.041641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:28.493145 run osmo-stp_10.42.42.5(pid=27097): stderr: | 20221209103727210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103727210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103727210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103727210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103727211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103727211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103727211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:28.620051 run osmo-stp_10.42.42.5(pid=27097): stdout: | (launched: 2022-12-09_10:37:27.041641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:28.741741 run osmo-stp_10.42.42.5(pid=27097): stderr: | 20221209103727210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103727210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103727210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103727210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103727211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103727211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103727211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:28.887238 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27097): Process ended prematurely: osmo-stp_10.42.42.5(pid=27097) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27097)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:37:28.896168 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:37:28.923000 run osmo-hlr_10.42.42.2(pid=27094): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27094)] 10:37:28.972233 run osmo-hlr_10.42.42.2(pid=27094): stdout: | (launched: 2022-12-09_10:37:26.093650) 10:37:29.022277 run osmo-hlr_10.42.42.2(pid=27094): stderr: | 20221209103726269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103726269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103726269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103726269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103726269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103726269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103726281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103726290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103726290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103726290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:29.091727 run osmo-msc_10.42.42.6(pid=27100): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27100)] 10:37:29.140037 run osmo-msc_10.42.42.6(pid=27100): stdout: | (launched: 2022-12-09_10:37:28.011232) 10:37:29.190088 run osmo-msc_10.42.42.6(pid=27100): stderr: | 20221209103728282 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103728282 DLGLOBAL DEBUG validating counter group 0x7fd2d4530c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103728282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103728282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103728282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103728283 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103728284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103728285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103728285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103728285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:37:29.240409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27093): Terminating (SIGTERM) 10:37:29.280592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27096): Terminating (SIGTERM) 10:37:29.320560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27099): Terminating (SIGTERM) 10:37:29.361031 --- ParallelTerminationStrategy: PID 27093 died... 10:37:29.380286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27093): Terminated: ok {rc=0} 10:37:29.424589 --- ParallelTerminationStrategy: PID 27096 died... 10:37:29.443568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27096): Terminated: ok {rc=0} 10:37:29.487892 --- ParallelTerminationStrategy: PID 27099 died... 10:37:29.506735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27099): Terminated: ok {rc=0} 10:37:29.593711 bus /sierra_3: Setting Powered False 10:37:30.694738 bus /sierra_3: Setting Powered False 10:37:31.811928 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:37:32.961399 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:32.973106 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:37:33.040899 tst mo_mt_call_osmux.py: using LAC 20881 10:37:33.161027 tst mo_mt_call_osmux.py: using RAC 226 10:37:33.281197 tst mo_mt_call_osmux.py: using CellId 20881 10:37:33.398528 tst mo_mt_call_osmux.py: using BVCI 20882 10:37:33.508060 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:33.519265 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:33.530345 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:33.541328 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:33.552292 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:37:33.563409 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:37:33.682796 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:37:33.804427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:34.310635 run create_hlr_db(pid=27104): Launched 10:37:34.438775 bus /sierra_2: Setting Powered False 10:37:35.503317 run create_hlr_db(pid=27104): Terminated: ok {rc=0} 10:37:35.943191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27106): Launched 10:37:36.248316 run osmo-hlr_10.42.42.2(pid=27107): Launched 10:37:36.364015 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:36.904591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27109): Launched 10:37:37.209365 run osmo-stp_10.42.42.5(pid=27110): Launched 10:37:37.326211 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:37.879681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27112): Launched 10:37:38.183395 run osmo-msc_10.42.42.6(pid=27113): Launched 10:37:38.353666 run osmo-stp_10.42.42.5(pid=27110): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27110)] 10:37:38.481546 run osmo-stp_10.42.42.5(pid=27110): stdout: | (launched: 2022-12-09_10:37:37.152681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:38.609627 run osmo-stp_10.42.42.5(pid=27110): stderr: | 20221209103737319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103737319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103737320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103737320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103737320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103737321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103737321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:38.736388 run osmo-stp_10.42.42.5(pid=27110): stdout: | (launched: 2022-12-09_10:37:37.152681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:38.857532 run osmo-stp_10.42.42.5(pid=27110): stderr: | 20221209103737319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103737319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103737320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103737320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103737320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103737321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103737321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:39.002185 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27110): Process ended prematurely: osmo-stp_10.42.42.5(pid=27110) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27110)] [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:37:39.011394 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:37:39.038529 run osmo-hlr_10.42.42.2(pid=27107): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27107)] 10:37:39.086949 run osmo-hlr_10.42.42.2(pid=27107): stdout: | (launched: 2022-12-09_10:37:36.192760) 10:37:39.137243 run osmo-hlr_10.42.42.2(pid=27107): stderr: | 20221209103736367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103736367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103736367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103736367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103736367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103736367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103736379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103736390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103736390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103736390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:39.206898 run osmo-msc_10.42.42.6(pid=27113): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27113)] 10:37:39.255175 run osmo-msc_10.42.42.6(pid=27113): stdout: | (launched: 2022-12-09_10:37:38.127496) 10:37:39.305488 run osmo-msc_10.42.42.6(pid=27113): stderr: | 20221209103738399 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103738399 DLGLOBAL DEBUG validating counter group 0x7f2742803c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103738399 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103738399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103738399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103738399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103738401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103738402 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103738402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103738402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:37:39.355895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27106): Terminating (SIGTERM) 10:37:39.395938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27109): Terminating (SIGTERM) 10:37:39.435844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27112): Terminating (SIGTERM) 10:37:39.476162 --- ParallelTerminationStrategy: PID 27106 died... 10:37:39.495481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27106): Terminated: ok {rc=0} 10:37:39.539837 --- ParallelTerminationStrategy: PID 27109 died... 10:37:39.558740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27109): Terminated: ok {rc=0} 10:37:39.602743 --- ParallelTerminationStrategy: PID 27112 died... 10:37:39.621568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27112): Terminated: ok {rc=0} 10:37:39.707973 bus /sierra_3: Setting Powered False 10:37:40.809663 bus /sierra_3: Setting Powered False 10:37:41.924859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:37:43.178289 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:43.186007 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:37:43.218565 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:37:43.244852 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:37:43.296163 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:37:43.328887 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:37:43.355205 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:37:43.906010 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:37:43.961054 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:43.972691 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:37:44.055734 tst mo_mt_call.py: using LAC 20882 10:37:44.191480 tst mo_mt_call.py: using RAC 227 10:37:44.321299 tst mo_mt_call.py: using CellId 20882 10:37:44.449773 tst mo_mt_call.py: using BVCI 20883 10:37:44.570374 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:44.581998 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:44.593441 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:44.605161 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:44.617210 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:44.628836 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:37:44.743514 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:37:44.863156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:45.370420 run create_hlr_db(pid=27118): Launched 10:37:45.497029 bus /sierra_2: Setting Powered False 10:37:46.571602 run create_hlr_db(pid=27118): Terminated: ok {rc=0} 10:37:47.049960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Launched 10:37:47.389765 run osmo-hlr_10.42.42.2(pid=27121): Launched 10:37:47.515832 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:48.074705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Launched 10:37:48.401892 run osmo-stp_10.42.42.5(pid=27124): Launched 10:37:48.528033 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:49.119574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27126): Launched 10:37:49.447711 run osmo-msc_10.42.42.6(pid=27127): Launched 10:37:49.630043 run osmo-stp_10.42.42.5(pid=27124): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27124)] 10:37:49.767036 run osmo-stp_10.42.42.5(pid=27124): stdout: | (launched: 2022-12-09_10:37:48.342857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:49.904803 run osmo-stp_10.42.42.5(pid=27124): stderr: | 20221209103748530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103748530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103748531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103748531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103748531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103748532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103748532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:50.041123 run osmo-stp_10.42.42.5(pid=27124): stdout: | (launched: 2022-12-09_10:37:48.342857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:50.170661 run osmo-stp_10.42.42.5(pid=27124): stderr: | 20221209103748530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103748530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103748531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103748531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103748531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103748532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103748532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:50.326241 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27124): Process ended prematurely: osmo-stp_10.42.42.5(pid=27124) [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27124)] [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:37:50.336114 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:37:50.365100 run osmo-hlr_10.42.42.2(pid=27121): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27121)] 10:37:50.416220 run osmo-hlr_10.42.42.2(pid=27121): stdout: | (launched: 2022-12-09_10:37:47.330011) 10:37:50.468790 run osmo-hlr_10.42.42.2(pid=27121): stderr: | 20221209103747522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103747522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103747522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103747522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103747522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103747522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103747534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103747543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103747543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103747543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:50.542100 run osmo-msc_10.42.42.6(pid=27127): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27127)] 10:37:50.593074 run osmo-msc_10.42.42.6(pid=27127): stdout: | (launched: 2022-12-09_10:37:49.388426) 10:37:50.645501 run osmo-msc_10.42.42.6(pid=27127): stderr: | 20221209103749706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103749706 DLGLOBAL DEBUG validating counter group 0x7ff58eca0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103749706 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103749706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103749706 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103749707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103749708 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103749709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103749709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103749709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:37:50.698423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Terminating (SIGTERM) 10:37:50.740784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Terminating (SIGTERM) 10:37:50.783319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27126): Terminating (SIGTERM) 10:37:50.826310 --- ParallelTerminationStrategy: PID 27120 died... 10:37:50.846582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Terminated: ok {rc=0} 10:37:50.894087 --- ParallelTerminationStrategy: PID 27123 died... 10:37:50.913939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Terminated: ok {rc=0} 10:37:50.960889 --- ParallelTerminationStrategy: PID 27126 died... 10:37:50.980929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27126): Terminated: ok {rc=0} 10:37:51.069616 bus /sierra_3: Setting Powered False 10:37:52.170779 bus /sierra_3: Setting Powered False 10:37:53.289173 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:37:54.441479 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:54.453965 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:37:54.527041 tst mo_mt_call_osmux.py: using LAC 20883 10:37:54.656123 tst mo_mt_call_osmux.py: using RAC 228 10:37:54.785509 tst mo_mt_call_osmux.py: using CellId 20883 10:37:54.907057 tst mo_mt_call_osmux.py: using BVCI 20884 10:37:55.019292 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:55.030665 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:55.041909 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:55.053479 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:55.065115 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:37:55.076521 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:37:55.196159 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:37:55.318185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:55.824645 run create_hlr_db(pid=27129): Launched 10:37:55.949800 bus /sierra_2: Setting Powered False 10:37:57.013200 run create_hlr_db(pid=27129): Terminated: ok {rc=0} 10:37:57.449234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27131): Launched 10:37:57.753334 run osmo-hlr_10.42.42.2(pid=27132): Launched 10:37:57.869878 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:58.394074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27134): Launched 10:37:58.696720 run osmo-stp_10.42.42.5(pid=27135): Launched 10:37:58.814627 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:59.368731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27137): Launched 10:37:59.673509 run osmo-msc_10.42.42.6(pid=27138): Launched 10:37:59.844472 run osmo-stp_10.42.42.5(pid=27135): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27135)] 10:37:59.973680 run osmo-stp_10.42.42.5(pid=27135): stdout: | (launched: 2022-12-09_10:37:58.640878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:00.102307 run osmo-stp_10.42.42.5(pid=27135): stderr: | 20221209103758810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103758810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103758810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103758810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103758811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103758811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103758811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:00.229613 run osmo-stp_10.42.42.5(pid=27135): stdout: | (launched: 2022-12-09_10:37:58.640878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:00.351352 run osmo-stp_10.42.42.5(pid=27135): stderr: | 20221209103758810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103758810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103758810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103758810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103758811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103758811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103758811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:00.497216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27135): Process ended prematurely: osmo-stp_10.42.42.5(pid=27135) [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27135)] [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:38:00.506103 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:38:00.533039 run osmo-hlr_10.42.42.2(pid=27132): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27132)] 10:38:00.580941 run osmo-hlr_10.42.42.2(pid=27132): stdout: | (launched: 2022-12-09_10:37:57.697867) 10:38:00.630486 run osmo-hlr_10.42.42.2(pid=27132): stderr: | 20221209103757870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103757870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103757870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103757871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103757871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103757871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103757883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103757891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103757891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103757892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:00.699605 run osmo-msc_10.42.42.6(pid=27138): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27138)] 10:38:00.747656 run osmo-msc_10.42.42.6(pid=27138): stdout: | (launched: 2022-12-09_10:37:59.617797) 10:38:00.797189 run osmo-msc_10.42.42.6(pid=27138): stderr: | 20221209103759886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103759886 DLGLOBAL DEBUG validating counter group 0x7f64bf836c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103759886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103759886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103759886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103759886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103759888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103759889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103759889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103759889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:00.865186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27131): Terminating (SIGTERM) 10:38:00.915415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27134): Terminating (SIGTERM) 10:38:00.962776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27137): Terminating (SIGTERM) 10:38:01.010728 --- ParallelTerminationStrategy: PID 27131 died... 10:38:01.031700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27131): Terminated: ok {rc=0} 10:38:01.083089 --- ParallelTerminationStrategy: PID 27134 died... 10:38:01.103810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27134): Terminated: ok {rc=0} 10:38:01.154185 --- ParallelTerminationStrategy: PID 27137 died... 10:38:01.175527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27137): Terminated: ok {rc=0} 10:38:01.269946 bus /sierra_3: Setting Powered False 10:38:02.403867 bus /sierra_3: Setting Powered False 10:38:03.545860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:38:04.808316 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:04.815453 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:38:04.854649 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:38:04.884440 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:38:04.939083 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:38:04.975525 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:38:05.006203 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:38:05.552322 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:38:05.610007 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:05.622685 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:38:05.696680 tst mo_mt_call.py: using LAC 20884 10:38:05.826859 tst mo_mt_call.py: using RAC 229 10:38:05.958409 tst mo_mt_call.py: using CellId 20884 10:38:06.092338 tst mo_mt_call.py: using BVCI 20885 10:38:06.215888 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:06.228643 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:06.241871 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:06.255139 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:06.268310 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:06.280487 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:38:06.407036 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:38:06.531030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:07.051351 run create_hlr_db(pid=27415): Launched 10:38:07.217263 bus /sierra_2: Setting Powered False 10:38:08.282760 run create_hlr_db(pid=27415): Terminated: ok {rc=0} 10:38:08.757886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27417): Launched 10:38:09.104912 run osmo-hlr_10.42.42.2(pid=27418): Launched 10:38:09.351857 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:10.032934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27420): Launched 10:38:10.379300 run osmo-stp_10.42.42.5(pid=27421): Launched 10:38:10.632134 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:11.321302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27423): Launched 10:38:11.670708 run osmo-msc_10.42.42.6(pid=27424): Launched 10:38:12.047949 run osmo-stp_10.42.42.5(pid=27421): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27421)] 10:38:12.330231 run osmo-stp_10.42.42.5(pid=27421): stdout: | (launched: 2022-12-09_10:38:10.318994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:12.499772 run osmo-stp_10.42.42.5(pid=27421): stderr: | 20221209103810612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103810613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103810613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103810613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103810614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103810614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103810614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:12.642703 run osmo-stp_10.42.42.5(pid=27421): stdout: | (launched: 2022-12-09_10:38:10.318994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:12.779014 run osmo-stp_10.42.42.5(pid=27421): stderr: | 20221209103810612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103810613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103810613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103810613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103810614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103810614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103810614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:12.941710 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27421): Process ended prematurely: osmo-stp_10.42.42.5(pid=27421) [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27421)] [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:38:12.952794 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 10:38:12.984747 run osmo-hlr_10.42.42.2(pid=27418): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27418)] 10:38:13.039489 run osmo-hlr_10.42.42.2(pid=27418): stdout: | (launched: 2022-12-09_10:38:09.044625) 10:38:13.095150 run osmo-hlr_10.42.42.2(pid=27418): stderr: | 20221209103809356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103809356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103809356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103809356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103809356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103809356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103809368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103809384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103809385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103809385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:13.172652 run osmo-msc_10.42.42.6(pid=27424): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27424)] 10:38:13.227824 run osmo-msc_10.42.42.6(pid=27424): stdout: | (launched: 2022-12-09_10:38:11.609539) 10:38:13.283245 run osmo-msc_10.42.42.6(pid=27424): stderr: | 20221209103812107 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103812107 DLGLOBAL DEBUG validating counter group 0x7f20d4ce9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103812107 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103812107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103812107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103812107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103812117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103812118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103812118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103812118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:13.339256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27417): Terminating (SIGTERM) 10:38:13.384786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27420): Terminating (SIGTERM) 10:38:13.434179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27423): Terminating (SIGTERM) 10:38:13.481479 --- ParallelTerminationStrategy: PID 27417 died... 10:38:13.502870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27417): Terminated: ok {rc=0} 10:38:13.554980 --- ParallelTerminationStrategy: PID 27420 died... 10:38:13.576493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27420): Terminated: ok {rc=0} 10:38:13.627757 --- ParallelTerminationStrategy: PID 27423 died... 10:38:13.648663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27423): Terminated: ok {rc=0} 10:38:13.743288 bus /sierra_3: Setting Powered False 10:38:14.851385 bus /sierra_3: Setting Powered False 10:38:15.983043 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:38:17.192586 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:17.210193 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:38:17.319871 tst mo_mt_call_osmux.py: using LAC 20885 10:38:17.474831 tst mo_mt_call_osmux.py: using RAC 230 10:38:17.595738 tst mo_mt_call_osmux.py: using CellId 20885 10:38:17.719147 tst mo_mt_call_osmux.py: using BVCI 20886 10:38:17.834195 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:17.845998 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:17.857674 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:17.869279 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:17.880868 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:38:17.892555 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:38:18.011275 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:38:18.132174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:18.614039 run create_hlr_db(pid=27426): Launched 10:38:18.779165 bus /sierra_2: Setting Powered False 10:38:19.842659 run create_hlr_db(pid=27426): Terminated: ok {rc=0} 10:38:20.284581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27428): Launched 10:38:20.622451 run osmo-hlr_10.42.42.2(pid=27429): Launched 10:38:20.860718 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:21.582292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27431): Launched 10:38:21.916075 run osmo-stp_10.42.42.5(pid=27432): Launched 10:38:22.155008 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:22.880691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27434): Launched 10:38:23.214831 run osmo-msc_10.42.42.6(pid=27435): Launched 10:38:23.580019 run osmo-stp_10.42.42.5(pid=27432): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27432)] 10:38:23.858387 run osmo-stp_10.42.42.5(pid=27432): stdout: | (launched: 2022-12-09_10:38:21.854425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:24.144223 run osmo-stp_10.42.42.5(pid=27432): stderr: | 20221209103822180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103822181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103822181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103822181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103822182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103822182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103822182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:24.292571 run osmo-stp_10.42.42.5(pid=27432): stdout: | (launched: 2022-12-09_10:38:21.854425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:24.416291 run osmo-stp_10.42.42.5(pid=27432): stderr: | 20221209103822180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103822181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103822181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103822181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103822182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103822182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103822182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:24.563388 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27432): Process ended prematurely: osmo-stp_10.42.42.5(pid=27432) [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27432)] [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:38:24.572369 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 10:38:24.601501 run osmo-hlr_10.42.42.2(pid=27429): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27429)] 10:38:24.652842 run osmo-hlr_10.42.42.2(pid=27429): stdout: | (launched: 2022-12-09_10:38:20.559028) 10:38:24.705821 run osmo-hlr_10.42.42.2(pid=27429): stderr: | 20221209103820905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103820905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103820905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103820905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103820905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103820905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103820921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103820937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103820937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103820937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:24.779211 run osmo-msc_10.42.42.6(pid=27435): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27435)] 10:38:24.830410 run osmo-msc_10.42.42.6(pid=27435): stdout: | (launched: 2022-12-09_10:38:23.151183) 10:38:24.883519 run osmo-msc_10.42.42.6(pid=27435): stderr: | 20221209103823749 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103823749 DLGLOBAL DEBUG validating counter group 0x7f09c1997c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103823749 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103823749 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103823750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103823750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103823751 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103823752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103823752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103823752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:24.936749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27428): Terminating (SIGTERM) 10:38:24.979198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27431): Terminating (SIGTERM) 10:38:25.021768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27434): Terminating (SIGTERM) 10:38:25.064698 --- ParallelTerminationStrategy: PID 27428 died... 10:38:25.085118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27428): Terminated: ok {rc=0} 10:38:25.132458 --- ParallelTerminationStrategy: PID 27431 died... 10:38:25.152310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27431): Terminated: ok {rc=0} 10:38:25.199408 --- ParallelTerminationStrategy: PID 27434 died... 10:38:25.219666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27434): Terminated: ok {rc=0} 10:38:25.309368 bus /sierra_3: Setting Powered False 10:38:26.410616 bus /sierra_3: Setting Powered False 10:38:27.529365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:trx-lms --------------------------------------------------------------------- 10:38:28.776859 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:28.782553 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 10:38:28.817282 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:38:28.845028 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 10:38:28.931250 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 10:38:28.964115 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:38:28.990625 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 10:38:29.573309 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 10:38:29.578469 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:29.589271 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:38:29.641661 tst emergency_mo_mt_call.py: using LAC 20886 10:38:29.758162 tst emergency_mo_mt_call.py: using RAC 231 10:38:29.873484 tst emergency_mo_mt_call.py: using CellId 20886 10:38:29.991516 tst emergency_mo_mt_call.py: using BVCI 20887 10:38:30.101056 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:30.111575 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:30.121993 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:30.132404 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:30.142783 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:30.153146 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:38:30.271409 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:38:30.393609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:30.913624 run create_hlr_db(pid=27441): Launched 10:38:31.083147 bus /sierra_2: Setting Powered False 10:38:32.162419 run create_hlr_db(pid=27441): Terminated: ok {rc=0} 10:38:32.613828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27443): Launched 10:38:32.936274 run osmo-hlr_10.42.42.2(pid=27444): Launched 10:38:33.058651 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:33.615003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27446): Launched 10:38:33.935542 run osmo-stp_10.42.42.5(pid=27447): Launched 10:38:34.068517 tst emergency_mo_mt_call.py: using MSISDN 7162 10:38:34.234744 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:34.812574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27449): Launched 10:38:35.133655 run osmo-msc_10.42.42.6(pid=27450): Launched 10:38:35.316704 run osmo-stp_10.42.42.5(pid=27447): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27447)] 10:38:35.452811 run osmo-stp_10.42.42.5(pid=27447): stdout: | (launched: 2022-12-09_10:38:33.876312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:35.589144 run osmo-stp_10.42.42.5(pid=27447): stderr: | 20221209103834069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103834069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103834069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103834070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103834070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103834070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103834070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:35.723624 run osmo-stp_10.42.42.5(pid=27447): stdout: | (launched: 2022-12-09_10:38:33.876312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:35.851850 run osmo-stp_10.42.42.5(pid=27447): stderr: | 20221209103834069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103834069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103834069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103834070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103834070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103834070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103834070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:36.004738 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27447): Process ended prematurely: osmo-stp_10.42.42.5(pid=27447) [trial-2358↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27447)] [trial-2358↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 10:38:36.014105 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 10:38:36.042591 run osmo-hlr_10.42.42.2(pid=27444): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27444)] 10:38:36.093787 run osmo-hlr_10.42.42.2(pid=27444): stdout: | (launched: 2022-12-09_10:38:32.877085) 10:38:36.146471 run osmo-hlr_10.42.42.2(pid=27444): stderr: | 20221209103833072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103833072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103833072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103833072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103833072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103833072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103833084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103833093 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103833093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103833093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:36.220047 run osmo-msc_10.42.42.6(pid=27450): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27450)] 10:38:36.271252 run osmo-msc_10.42.42.6(pid=27450): stdout: | (launched: 2022-12-09_10:38:35.074467) 10:38:36.323779 run osmo-msc_10.42.42.6(pid=27450): stderr: | 20221209103835394 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103835395 DLGLOBAL DEBUG validating counter group 0x7f86e5437c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103835395 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103835395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103835395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103835395 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103835397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103835397 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103835398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103835398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:36.376856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27443): Terminating (SIGTERM) 10:38:36.419256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27446): Terminating (SIGTERM) 10:38:36.461868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27449): Terminating (SIGTERM) 10:38:36.504805 --- ParallelTerminationStrategy: PID 27443 died... 10:38:36.525138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27443): Terminated: ok {rc=0} 10:38:36.572648 --- ParallelTerminationStrategy: PID 27446 died... 10:38:36.592564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27446): Terminated: ok {rc=0} 10:38:36.640120 --- ParallelTerminationStrategy: PID 27449 died... 10:38:36.660106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27449): Terminated: ok {rc=0} 10:38:36.748783 bus /sierra_3: Setting Powered False 10:38:37.850003 bus /sierra_3: Setting Powered False 10:38:38.970110 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 10:38:40.058458 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:40.069864 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:38:40.121137 tst emergency_preemptive_call.py: using LAC 20887 10:38:40.241537 tst emergency_preemptive_call.py: using RAC 232 10:38:40.360152 tst emergency_preemptive_call.py: using CellId 20887 10:38:40.478869 tst emergency_preemptive_call.py: using BVCI 20888 10:38:40.589141 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:40.599665 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:40.610107 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:40.620476 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:40.630902 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:38:40.641260 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:38:40.755249 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:38:40.874397 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:38:40.988859 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:38:41.106537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:41.605674 run create_hlr_db(pid=27453): Launched 10:38:41.731076 bus /sierra_2: Setting Powered False 10:38:42.793981 run create_hlr_db(pid=27453): Terminated: ok {rc=0} 10:38:43.222817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27455): Launched 10:38:43.523411 run osmo-hlr_10.42.42.2(pid=27456): Launched 10:38:43.640036 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:44.156295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27458): Launched 10:38:44.455479 run osmo-stp_10.42.42.5(pid=27459): Launched 10:38:44.581264 tst emergency_preemptive_call.py: using MSISDN 7163 10:38:44.733642 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:45.272374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27461): Launched 10:38:45.571909 run osmo-msc_10.42.42.6(pid=27462): Launched 10:38:45.739128 run osmo-stp_10.42.42.5(pid=27459): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27459)] 10:38:45.885714 run osmo-stp_10.42.42.5(pid=27459): stdout: | (launched: 2022-12-09_10:38:44.399922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:46.106208 run osmo-stp_10.42.42.5(pid=27459): stderr: | 20221209103844566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103844567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103844567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103844567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103844568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103844568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103844568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:46.236634 run osmo-stp_10.42.42.5(pid=27459): stdout: | (launched: 2022-12-09_10:38:44.399922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:46.360698 run osmo-stp_10.42.42.5(pid=27459): stderr: | 20221209103844566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103844567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103844567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103844567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103844568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103844568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103844568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:46.505442 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27459): Process ended prematurely: osmo-stp_10.42.42.5(pid=27459) [trial-2358↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27459)] [trial-2358↪emergency:trx-lms↪emergency_preemptive_call.py:32] 10:38:46.514481 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 10:38:46.542474 run osmo-hlr_10.42.42.2(pid=27456): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27456)] 10:38:46.592400 run osmo-hlr_10.42.42.2(pid=27456): stdout: | (launched: 2022-12-09_10:38:43.467415) 10:38:46.643725 run osmo-hlr_10.42.42.2(pid=27456): stderr: | 20221209103843640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103843640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103843640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103843640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103843640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103843641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103843652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103843661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103843661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103843661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:46.714807 run osmo-msc_10.42.42.6(pid=27462): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27462)] 10:38:46.764689 run osmo-msc_10.42.42.6(pid=27462): stdout: | (launched: 2022-12-09_10:38:45.515889) 10:38:46.816203 run osmo-msc_10.42.42.6(pid=27462): stderr: | 20221209103845784 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209103845784 DLGLOBAL DEBUG validating counter group 0x7fdb1c9d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209103845784 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209103845784 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209103845785 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209103845785 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209103845787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209103845787 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209103845787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209103845787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:46.867816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27455): Terminating (SIGTERM) 10:38:46.909362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27458): Terminating (SIGTERM) 10:38:46.950260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27461): Terminating (SIGTERM) 10:38:46.991271 --- ParallelTerminationStrategy: PID 27455 died... 10:38:47.010660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27455): Terminated: ok {rc=0} 10:38:47.055890 --- ParallelTerminationStrategy: PID 27458 died... 10:38:47.075311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27458): Terminated: ok {rc=0} 10:38:47.120365 --- ParallelTerminationStrategy: PID 27461 died... 10:38:47.140140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27461): Terminated: ok {rc=0} 10:38:47.225049 bus /sierra_9: Setting Powered False 10:38:48.331224 bus /sierra_9: Setting Powered False 10:38:49.448772 bus /sierra_8: Setting Powered False 10:38:50.546814 bus /sierra_8: Setting Powered False 10:38:51.665559 bus /sierra_3: Setting Powered False 10:38:52.764778 bus /sierra_3: Setting Powered False 10:38:53.883319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms --------------------------------------------------------------------- 10:38:55.156138 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:55.160752 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 10:38:55.193192 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 10:38:55.231059 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 10:38:55.315870 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 10:38:55.349146 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 10:38:55.386955 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 10:38:55.976282 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 10:38:56.026057 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.036518 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:38:56.083703 tst cs_paging_gprs_active.py: using LAC 20888 10:38:56.202807 tst cs_paging_gprs_active.py: using RAC 233 10:38:56.322546 tst cs_paging_gprs_active.py: using CellId 20888 10:38:56.441578 tst cs_paging_gprs_active.py: using BVCI 20889 10:38:56.551482 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.562185 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.572423 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.582813 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.593105 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.603392 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.613851 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.624030 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:38:56.634473 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:38:56.752308 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:38:56.870615 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:38:57.074277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:57.381851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27467): Launched 10:38:57.649654 run iperf3-srv_10.42.42.10(pid=27468): Launched 10:38:57.765190 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:38:57.969267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:58.277198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27469): Launched 10:38:58.542590 run iperf3-srv_10.42.42.10(pid=27470): Launched 10:38:58.658752 tst cs_paging_gprs_active.py:38: start network... 10:38:58.861952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:59.334421 run create_hlr_db(pid=27471): Launched 10:38:59.462016 bus /sierra_2: Setting Powered False 10:39:00.522416 run create_hlr_db(pid=27471): Terminated: ok {rc=0} 10:39:00.977434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27473): Launched 10:39:01.300154 run osmo-hlr_10.42.42.2(pid=27474): Launched 10:39:01.589063 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:02.209263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27476): Launched 10:39:02.532070 run osmo-stp_10.42.42.5(pid=27477): Launched 10:39:02.648459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:03.176844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27479): Launched 10:39:03.293063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:03.551535 run patchelf(pid=27480): Launched 10:39:03.721167 run osmo-stp_10.42.42.5(pid=27477): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27477)] 10:39:03.849399 run osmo-stp_10.42.42.5(pid=27477): stdout: | (launched: 2022-12-09_10:39:02.475192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:03.978981 run osmo-stp_10.42.42.5(pid=27477): stderr: | 20221209103902644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103902644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103902644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103902645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103902645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103902645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103902645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:04.108577 run osmo-stp_10.42.42.5(pid=27477): stdout: | (launched: 2022-12-09_10:39:02.475192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:04.232938 run osmo-stp_10.42.42.5(pid=27477): stderr: | 20221209103902644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103902644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103902644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103902645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103902645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103902645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103902645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:04.380654 run patchelf(pid=27480): Terminating (SIGINT) 10:39:04.551201 run patchelf(pid=27480): Terminated: ok {rc=0} 10:39:04.673842 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27477): Process ended prematurely: osmo-stp_10.42.42.5(pid=27477) [trial-2358↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27477)] [trial-2358↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 10:39:04.683308 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:39:04.710746 run osmo-hlr_10.42.42.2(pid=27474): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27474)] 10:39:04.759150 run osmo-hlr_10.42.42.2(pid=27474): stdout: | (launched: 2022-12-09_10:39:01.241480) 10:39:04.809170 run osmo-hlr_10.42.42.2(pid=27474): stderr: | 20221209103901447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103901448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103901448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103901448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103901448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103901448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103901465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103901481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103901481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103901481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:04.859472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27467): Terminating (SIGTERM) 10:39:04.899768 run iperf3-srv_10.42.42.10(pid=27468): Terminating (SIGTERM) 10:39:04.939921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27469): Terminating (SIGTERM) 10:39:04.980102 run iperf3-srv_10.42.42.10(pid=27470): Terminating (SIGTERM) 10:39:05.020157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27473): Terminating (SIGTERM) 10:39:05.060312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27476): Terminating (SIGTERM) 10:39:05.100256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27479): Terminating (SIGTERM) 10:39:05.140525 --- ParallelTerminationStrategy: PID 27467 died... 10:39:05.159803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27467): Terminated: ok {rc=0} 10:39:05.204030 --- ParallelTerminationStrategy: PID 27468 died... 10:39:05.222787 run iperf3-srv_10.42.42.10(pid=27468): Terminated {rc=256} 10:39:05.266862 --- ParallelTerminationStrategy: PID 27469 died... 10:39:05.285637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27469): Terminated: ok {rc=0} 10:39:05.329598 --- ParallelTerminationStrategy: PID 27470 died... 10:39:05.348290 run iperf3-srv_10.42.42.10(pid=27470): Terminated {rc=256} 10:39:05.392675 --- ParallelTerminationStrategy: PID 27473 died... 10:39:05.411567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27473): Terminated: ok {rc=0} 10:39:05.455729 --- ParallelTerminationStrategy: PID 27476 died... 10:39:05.474451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27476): Terminated: ok {rc=0} 10:39:05.518542 --- ParallelTerminationStrategy: PID 27479 died... 10:39:05.537318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27479): Terminated: ok {rc=0} 10:39:05.623823 bus /gobi_0: Setting Powered False 10:39:06.725891 bus /gobi_0: Setting Powered False 10:39:07.842289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms iperf3.py ---------------------------------------------- 10:39:08.990005 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.001087 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:39:09.053283 tst iperf3.py: using LAC 20889 10:39:09.175031 tst iperf3.py: using RAC 234 10:39:09.293437 tst iperf3.py: using CellId 20889 10:39:09.410351 tst iperf3.py: using BVCI 20890 10:39:09.520495 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.531069 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.541395 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.551619 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.561912 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.572170 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.582598 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.592768 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:09.603147 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:09.722546 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:39:09.943181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:10.272478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27481): Launched 10:39:10.560859 run iperf3-srv_10.42.42.10(pid=27482): Launched 10:39:10.684875 tst iperf3.py:8: start network... 10:39:10.904350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:11.411091 run create_hlr_db(pid=27483): Launched 10:39:11.538253 bus /gobi_6: Setting Powered False 10:39:12.602779 run create_hlr_db(pid=27483): Terminated: ok {rc=0} 10:39:13.038966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27485): Launched 10:39:13.346723 run osmo-hlr_10.42.42.2(pid=27486): Launched 10:39:13.466800 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:13.995540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27488): Launched 10:39:14.301473 run osmo-stp_10.42.42.5(pid=27489): Launched 10:39:14.419469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:14.947348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27491): Launched 10:39:15.063909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:15.321749 run patchelf(pid=27492): Launched 10:39:15.492576 run osmo-stp_10.42.42.5(pid=27489): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27489)] 10:39:15.622141 run osmo-stp_10.42.42.5(pid=27489): stdout: | (launched: 2022-12-09_10:39:14.244708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:15.752653 run osmo-stp_10.42.42.5(pid=27489): stderr: | 20221209103914413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103914413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103914413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103914414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103914414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103914414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103914414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:15.885342 run osmo-stp_10.42.42.5(pid=27489): stdout: | (launched: 2022-12-09_10:39:14.244708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:16.022069 run osmo-stp_10.42.42.5(pid=27489): stderr: | 20221209103914413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103914413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103914413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103914414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103914414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103914414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103914414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:16.171183 run patchelf(pid=27492): Terminating (SIGINT) 10:39:16.343975 run patchelf(pid=27492): Terminated: ok {rc=0} 10:39:16.468476 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27489): Process ended prematurely: osmo-stp_10.42.42.5(pid=27489) [trial-2358↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27489)] [trial-2358↪gprs:trx-lms↪iperf3.py:8] 10:39:16.479110 tst iperf3.py:8: Test FAILED (7.5 sec) 10:39:16.507808 run osmo-hlr_10.42.42.2(pid=27486): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27486)] 10:39:16.556929 run osmo-hlr_10.42.42.2(pid=27486): stdout: | (launched: 2022-12-09_10:39:13.290114) 10:39:16.607584 run osmo-hlr_10.42.42.2(pid=27486): stderr: | 20221209103913464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103913464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103913464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103913465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103913465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103913465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103913476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103913486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103913486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103913486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:16.658463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27481): Terminating (SIGTERM) 10:39:16.699919 run iperf3-srv_10.42.42.10(pid=27482): Terminating (SIGTERM) 10:39:16.744031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27485): Terminating (SIGTERM) 10:39:16.785566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27488): Terminating (SIGTERM) 10:39:16.826613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27491): Terminating (SIGTERM) 10:39:16.867750 --- ParallelTerminationStrategy: PID 27481 died... 10:39:16.887476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27481): Terminated: ok {rc=0} 10:39:16.932194 --- ParallelTerminationStrategy: PID 27482 died... 10:39:16.951662 run iperf3-srv_10.42.42.10(pid=27482): Terminated {rc=256} 10:39:17.000534 --- ParallelTerminationStrategy: PID 27485 died... 10:39:17.029077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27485): Terminated: ok {rc=0} 10:39:17.077378 --- ParallelTerminationStrategy: PID 27488 died... 10:39:17.096555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27488): Terminated: ok {rc=0} 10:39:17.142278 --- ParallelTerminationStrategy: PID 27491 died... 10:39:17.161738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27491): Terminated: ok {rc=0} 10:39:17.248437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms iperf3m4.py ---------------------------------------------- 10:39:18.391391 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.402429 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:39:18.451225 tst iperf3m4.py: using LAC 20890 10:39:18.570548 tst iperf3m4.py: using RAC 235 10:39:18.689319 tst iperf3m4.py: using CellId 20890 10:39:18.806245 tst iperf3m4.py: using BVCI 20891 10:39:18.916863 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.927477 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.937858 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.948097 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.958297 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.968495 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.978925 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.989209 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:18.999558 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:19.117617 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:19.243659 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:19.359253 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:19.474637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:39:19.677401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:19.979413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27493): Launched 10:39:20.241935 run iperf3-srv_10.42.42.10(pid=27494): Launched 10:39:20.357616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:39:20.558896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:20.862368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27495): Launched 10:39:21.126451 run iperf3-srv_10.42.42.10(pid=27496): Launched 10:39:21.241562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:39:21.441357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:21.743908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27497): Launched 10:39:22.007009 run iperf3-srv_10.42.42.10(pid=27498): Launched 10:39:22.119528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:39:22.319121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:22.620344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27499): Launched 10:39:22.883783 run iperf3-srv_10.42.42.10(pid=27500): Launched 10:39:22.996642 tst iperf3m4.py:8: start network... 10:39:23.196804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:23.664848 run create_hlr_db(pid=27501): Launched 10:39:23.788747 bus /gobi_6: Setting Powered False 10:39:24.849193 run create_hlr_db(pid=27501): Terminated: ok {rc=0} 10:39:25.290675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27503): Launched 10:39:25.615722 run osmo-hlr_10.42.42.2(pid=27504): Launched 10:39:25.740653 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:26.302498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27506): Launched 10:39:26.626544 run osmo-stp_10.42.42.5(pid=27507): Launched 10:39:26.750670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:27.306618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27509): Launched 10:39:27.430911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:27.703553 run patchelf(pid=27510): Launched 10:39:27.885096 run osmo-stp_10.42.42.5(pid=27507): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27507)] 10:39:28.021629 run osmo-stp_10.42.42.5(pid=27507): stdout: | (launched: 2022-12-09_10:39:26.567296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:28.159262 run osmo-stp_10.42.42.5(pid=27507): stderr: | 20221209103926754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103926754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103926755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103926755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103926756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103926756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103926756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:28.297796 run osmo-stp_10.42.42.5(pid=27507): stdout: | (launched: 2022-12-09_10:39:26.567296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:28.430635 run osmo-stp_10.42.42.5(pid=27507): stderr: | 20221209103926754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103926754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103926755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103926755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103926756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103926756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103926756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:28.587381 run patchelf(pid=27510): Terminating (SIGINT) 10:39:28.768199 run patchelf(pid=27510): Terminated: ok {rc=0} 10:39:28.898717 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27507): Process ended prematurely: osmo-stp_10.42.42.5(pid=27507) [trial-2358↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27507)] [trial-2358↪gprs:trx-lms↪iperf3m4.py:8] 10:39:28.909249 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:39:28.939187 run osmo-hlr_10.42.42.2(pid=27504): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27504)] 10:39:28.990297 run osmo-hlr_10.42.42.2(pid=27504): stdout: | (launched: 2022-12-09_10:39:25.556152) 10:39:29.043031 run osmo-hlr_10.42.42.2(pid=27504): stderr: | 20221209103925749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103925749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103925749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103925749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103925749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103925749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103925761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103925771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103925771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103925771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:29.095878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27493): Terminating (SIGTERM) 10:39:29.138336 run iperf3-srv_10.42.42.10(pid=27494): Terminating (SIGTERM) 10:39:29.180764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27495): Terminating (SIGTERM) 10:39:29.223454 run iperf3-srv_10.42.42.10(pid=27496): Terminating (SIGTERM) 10:39:29.266039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27497): Terminating (SIGTERM) 10:39:29.308555 run iperf3-srv_10.42.42.10(pid=27498): Terminating (SIGTERM) 10:39:29.351177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27499): Terminating (SIGTERM) 10:39:29.393510 run iperf3-srv_10.42.42.10(pid=27500): Terminating (SIGTERM) 10:39:29.435676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27503): Terminating (SIGTERM) 10:39:29.478145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27506): Terminating (SIGTERM) 10:39:29.520479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27509): Terminating (SIGTERM) 10:39:29.563044 --- ParallelTerminationStrategy: PID 27493 died... 10:39:29.583120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27493): Terminated: ok {rc=0} 10:39:29.630142 --- ParallelTerminationStrategy: PID 27494 died... 10:39:29.649760 run iperf3-srv_10.42.42.10(pid=27494): Terminated {rc=256} 10:39:29.696160 --- ParallelTerminationStrategy: PID 27495 died... 10:39:29.715773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27495): Terminated: ok {rc=0} 10:39:29.762546 --- ParallelTerminationStrategy: PID 27496 died... 10:39:29.782082 run iperf3-srv_10.42.42.10(pid=27496): Terminated {rc=256} 10:39:29.828597 --- ParallelTerminationStrategy: PID 27497 died... 10:39:29.848213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27497): Terminated: ok {rc=0} 10:39:29.894687 --- ParallelTerminationStrategy: PID 27498 died... 10:39:29.914059 run iperf3-srv_10.42.42.10(pid=27498): Terminated {rc=256} 10:39:29.960611 --- ParallelTerminationStrategy: PID 27499 died... 10:39:29.980296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27499): Terminated: ok {rc=0} 10:39:30.026876 --- ParallelTerminationStrategy: PID 27500 died... 10:39:30.046455 run iperf3-srv_10.42.42.10(pid=27500): Terminated {rc=256} 10:39:30.093152 --- ParallelTerminationStrategy: PID 27503 died... 10:39:30.112777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27503): Terminated: ok {rc=0} 10:39:30.159190 --- ParallelTerminationStrategy: PID 27506 died... 10:39:30.178847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27506): Terminated: ok {rc=0} 10:39:30.225459 --- ParallelTerminationStrategy: PID 27509 died... 10:39:30.245450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27509): Terminated: ok {rc=0} 10:39:30.334000 bus /gobi_4: Setting Powered False 10:39:31.434175 bus /gobi_4: Setting Powered False 10:39:32.549890 bus /gobi_1: Setting Powered False 10:39:33.648469 bus /gobi_1: Setting Powered False 10:39:34.764780 bus /gobi_0: Setting Powered False 10:39:35.861889 bus /gobi_0: Setting Powered False 10:39:36.980594 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms ping.py ---------------------------------------------- 10:39:38.083212 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.094604 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:39:38.147445 tst ping.py: using LAC 20891 10:39:38.266678 tst ping.py: using RAC 236 10:39:38.381179 tst ping.py: using CellId 20891 10:39:38.495897 tst ping.py: using BVCI 20892 10:39:38.603297 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.614041 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.624461 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.635162 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.646030 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.656442 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.667216 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:38.677898 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:38.791777 tst ping.py:19: start network... 10:39:38.987991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:39.446815 run create_hlr_db(pid=27511): Launched 10:39:39.569691 bus /gobi_6: Setting Powered False 10:39:40.629266 run create_hlr_db(pid=27511): Terminated: ok {rc=0} 10:39:41.044302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27513): Launched 10:39:41.339642 run osmo-hlr_10.42.42.2(pid=27514): Launched 10:39:41.451745 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:41.978538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27516): Launched 10:39:42.275252 run osmo-stp_10.42.42.5(pid=27517): Launched 10:39:42.387805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:42.897571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27519): Launched 10:39:43.011715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:43.262830 run patchelf(pid=27520): Launched 10:39:43.429925 run osmo-stp_10.42.42.5(pid=27517): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27517)] 10:39:43.555368 run osmo-stp_10.42.42.5(pid=27517): stdout: | (launched: 2022-12-09_10:39:42.219593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:43.682200 run osmo-stp_10.42.42.5(pid=27517): stderr: | 20221209103942384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103942385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103942385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103942385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103942386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103942386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103942386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:43.809963 run osmo-stp_10.42.42.5(pid=27517): stdout: | (launched: 2022-12-09_10:39:42.219593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:43.931277 run osmo-stp_10.42.42.5(pid=27517): stderr: | 20221209103942384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103942385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103942385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103942385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103942386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103942386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103942386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:44.074938 run patchelf(pid=27520): Terminating (SIGINT) 10:39:44.241202 run patchelf(pid=27520): Terminated: ok {rc=0} 10:39:44.360633 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27517): Process ended prematurely: osmo-stp_10.42.42.5(pid=27517) [trial-2358↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27517)] [trial-2358↪gprs:trx-lms↪ping.py:22] 10:39:44.369660 tst ping.py:22: Test FAILED (6.3 sec) 10:39:44.396628 run osmo-hlr_10.42.42.2(pid=27514): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27514)] 10:39:44.444370 run osmo-hlr_10.42.42.2(pid=27514): stdout: | (launched: 2022-12-09_10:39:41.285213) 10:39:44.493897 run osmo-hlr_10.42.42.2(pid=27514): stderr: | 20221209103941456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103941456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103941456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103941456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103941456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103941456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103941467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103941476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103941476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103941476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:44.543775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27513): Terminating (SIGTERM) 10:39:44.583882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27516): Terminating (SIGTERM) 10:39:44.623895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27519): Terminating (SIGTERM) 10:39:44.664235 --- ParallelTerminationStrategy: PID 27513 died... 10:39:44.683747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27513): Terminated: ok {rc=0} 10:39:44.728310 --- ParallelTerminationStrategy: PID 27516 died... 10:39:44.747198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27516): Terminated: ok {rc=0} 10:39:44.791521 --- ParallelTerminationStrategy: PID 27519 died... 10:39:44.810411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27519): Terminated: ok {rc=0} 10:39:44.896574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 10:39:45.986403 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:45.999071 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:39:46.053093 tst ping_idle_ping.py: using LAC 20892 10:39:46.181107 tst ping_idle_ping.py: using RAC 237 10:39:46.311800 tst ping_idle_ping.py: using CellId 20892 10:39:46.430339 tst ping_idle_ping.py: using BVCI 20893 10:39:46.568006 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.579429 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.590387 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.601583 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.612888 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.623760 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.635250 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:39:46.646475 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:39:46.762660 tst ping_idle_ping.py:24: start network... 10:39:46.964588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:47.432707 run create_hlr_db(pid=27521): Launched 10:39:47.555679 bus /gobi_6: Setting Powered False 10:39:48.615113 run create_hlr_db(pid=27521): Terminated: ok {rc=0} 10:39:49.051717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27523): Launched 10:39:49.371393 run osmo-hlr_10.42.42.2(pid=27524): Launched 10:39:49.494355 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:50.016086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27526): Launched 10:39:50.313335 run osmo-stp_10.42.42.5(pid=27527): Launched 10:39:50.426247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:50.936913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27529): Launched 10:39:51.050704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:51.301239 run patchelf(pid=27530): Launched 10:39:51.466306 run osmo-stp_10.42.42.5(pid=27527): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27527)] 10:39:51.591517 run osmo-stp_10.42.42.5(pid=27527): stdout: | (launched: 2022-12-09_10:39:50.257950) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:51.717789 run osmo-stp_10.42.42.5(pid=27527): stderr: | 20221209103950424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103950424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103950424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103950425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103950425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103950425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103950425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:51.845367 run osmo-stp_10.42.42.5(pid=27527): stdout: | (launched: 2022-12-09_10:39:50.257950) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:51.966915 run osmo-stp_10.42.42.5(pid=27527): stderr: | 20221209103950424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209103950424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209103950424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209103950425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209103950425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209103950425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209103950425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:52.110521 run patchelf(pid=27530): Terminating (SIGINT) 10:39:52.276343 run patchelf(pid=27530): Terminated: ok {rc=0} 10:39:52.396070 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27527): Process ended prematurely: osmo-stp_10.42.42.5(pid=27527) [trial-2358↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27527)] [trial-2358↪gprs:trx-lms↪ping_idle_ping.py:27] 10:39:52.405137 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:39:52.432215 run osmo-hlr_10.42.42.2(pid=27524): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27524)] 10:39:52.479776 run osmo-hlr_10.42.42.2(pid=27524): stdout: | (launched: 2022-12-09_10:39:49.312753) 10:39:52.529349 run osmo-hlr_10.42.42.2(pid=27524): stderr: | 20221209103949508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209103949508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209103949508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209103949508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209103949508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209103949508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209103949526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209103949535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209103949535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209103949535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:52.579145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27523): Terminating (SIGTERM) 10:39:52.618967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27526): Terminating (SIGTERM) 10:39:52.658900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27529): Terminating (SIGTERM) 10:39:52.699236 --- ParallelTerminationStrategy: PID 27523 died... 10:39:52.718498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27523): Terminated: ok {rc=0} 10:39:52.762902 --- ParallelTerminationStrategy: PID 27526 died... 10:39:52.781776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27526): Terminated: ok {rc=0} 10:39:52.825843 --- ParallelTerminationStrategy: PID 27529 died... 10:39:52.844601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27529): Terminated: ok {rc=0} 10:39:52.930949 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 10:39:54.239542 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:39:54.245479 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:39:54.280048 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:39:54.319593 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:39:54.408347 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:39:54.442396 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:39:54.481591 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:39:55.074420 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:39:55.127568 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.138934 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:39:55.190768 tst cs_paging_gprs_active.py: using LAC 20893 10:39:55.320353 tst cs_paging_gprs_active.py: using RAC 238 10:39:55.447407 tst cs_paging_gprs_active.py: using CellId 20893 10:39:55.574572 tst cs_paging_gprs_active.py: using BVCI 20894 10:39:55.694578 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.705931 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.716863 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.728192 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.739514 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.750855 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.762670 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.774159 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:39:55.785795 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:39:55.907907 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:39:56.027605 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:39:56.247029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:56.574139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27534): Launched 10:39:56.857083 run iperf3-srv_10.42.42.10(pid=27535): Launched 10:39:56.988711 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:39:57.206700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:57.531726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27536): Launched 10:39:57.813429 run iperf3-srv_10.42.42.10(pid=27537): Launched 10:39:57.937962 tst cs_paging_gprs_active.py:38: start network... 10:39:58.156930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:58.660653 run create_hlr_db(pid=27538): Launched 10:39:58.784381 bus /gobi_6: Setting Powered False 10:39:59.848820 run create_hlr_db(pid=27538): Terminated: ok {rc=0} 10:40:00.280228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27540): Launched 10:40:00.582042 run osmo-hlr_10.42.42.2(pid=27541): Launched 10:40:00.697188 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:01.248474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27543): Launched 10:40:01.585836 run osmo-stp_10.42.42.5(pid=27544): Launched 10:40:01.859491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:02.434800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27549): Launched 10:40:02.549536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:02.802948 run patchelf(pid=27550): Launched 10:40:02.972170 run osmo-stp_10.42.42.5(pid=27544): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27544)] 10:40:03.099642 run osmo-stp_10.42.42.5(pid=27544): stdout: | (launched: 2022-12-09_10:40:01.526662) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:03.228153 run osmo-stp_10.42.42.5(pid=27544): stderr: | 20221209104001715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104001715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104001716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104001716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104001717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104001717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104001717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:03.357202 run osmo-stp_10.42.42.5(pid=27544): stdout: | (launched: 2022-12-09_10:40:01.526662) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:03.480686 run osmo-stp_10.42.42.5(pid=27544): stderr: | 20221209104001715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104001715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104001716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104001716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104001717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104001717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104001717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:03.627326 run patchelf(pid=27550): Terminating (SIGINT) 10:40:03.795781 run patchelf(pid=27550): Terminated: ok {rc=0} 10:40:03.917711 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27544): Process ended prematurely: osmo-stp_10.42.42.5(pid=27544) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27544)] [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:40:03.927193 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:40:03.954326 run osmo-hlr_10.42.42.2(pid=27541): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27541)] 10:40:04.001554 run osmo-hlr_10.42.42.2(pid=27541): stdout: | (launched: 2022-12-09_10:40:00.526842) 10:40:04.050601 run osmo-hlr_10.42.42.2(pid=27541): stderr: | 20221209104000701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104000701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104000701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104000701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104000701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104000701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104000713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104000723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104000723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104000723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:04.100024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27534): Terminating (SIGTERM) 10:40:04.139463 run iperf3-srv_10.42.42.10(pid=27535): Terminating (SIGTERM) 10:40:04.178768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27536): Terminating (SIGTERM) 10:40:04.218236 run iperf3-srv_10.42.42.10(pid=27537): Terminating (SIGTERM) 10:40:04.257559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27540): Terminating (SIGTERM) 10:40:04.296935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27543): Terminating (SIGTERM) 10:40:04.336278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27549): Terminating (SIGTERM) 10:40:04.375964 --- ParallelTerminationStrategy: PID 27534 died... 10:40:04.394984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27534): Terminated: ok {rc=0} 10:40:04.438789 --- ParallelTerminationStrategy: PID 27535 died... 10:40:04.457433 run iperf3-srv_10.42.42.10(pid=27535): Terminated {rc=256} 10:40:04.500682 --- ParallelTerminationStrategy: PID 27536 died... 10:40:04.519364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27536): Terminated: ok {rc=0} 10:40:04.562805 --- ParallelTerminationStrategy: PID 27537 died... 10:40:04.581344 run iperf3-srv_10.42.42.10(pid=27537): Terminated {rc=256} 10:40:04.625247 --- ParallelTerminationStrategy: PID 27540 died... 10:40:04.643762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27540): Terminated: ok {rc=0} 10:40:04.687621 --- ParallelTerminationStrategy: PID 27543 died... 10:40:04.706251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27543): Terminated: ok {rc=0} 10:40:04.749724 --- ParallelTerminationStrategy: PID 27549 died... 10:40:04.768384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27549): Terminated: ok {rc=0} 10:40:04.853958 bus /gobi_0: Setting Powered False 10:40:05.953913 bus /gobi_0: Setting Powered False 10:40:07.068489 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:40:08.215436 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.226795 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:40:08.277328 tst iperf3.py: using LAC 20894 10:40:08.397062 tst iperf3.py: using RAC 239 10:40:08.516776 tst iperf3.py: using CellId 20894 10:40:08.635455 tst iperf3.py: using BVCI 20895 10:40:08.744334 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.755137 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.765779 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.776320 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.787301 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.797827 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.808499 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.818995 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:08.829746 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:08.943119 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:40:09.144220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:09.447306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27551): Launched 10:40:09.710587 run iperf3-srv_10.42.42.10(pid=27552): Launched 10:40:09.825716 tst iperf3.py:8: start network... 10:40:10.026540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:10.493508 run create_hlr_db(pid=27553): Launched 10:40:10.617862 bus /gobi_6: Setting Powered False 10:40:11.679287 run create_hlr_db(pid=27553): Terminated: ok {rc=0} 10:40:12.099272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27555): Launched 10:40:12.399923 run osmo-hlr_10.42.42.2(pid=27556): Launched 10:40:12.514443 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:13.043282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27558): Launched 10:40:13.344103 run osmo-stp_10.42.42.5(pid=27559): Launched 10:40:13.459074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:13.981234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27561): Launched 10:40:14.095293 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:14.348143 run patchelf(pid=27562): Launched 10:40:14.515131 run osmo-stp_10.42.42.5(pid=27559): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27559)] 10:40:14.641592 run osmo-stp_10.42.42.5(pid=27559): stdout: | (launched: 2022-12-09_10:40:13.288453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:14.769353 run osmo-stp_10.42.42.5(pid=27559): stderr: | 20221209104013455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104013455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104013456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104013456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104013457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104013457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104013457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:14.897529 run osmo-stp_10.42.42.5(pid=27559): stdout: | (launched: 2022-12-09_10:40:13.288453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:15.020233 run osmo-stp_10.42.42.5(pid=27559): stderr: | 20221209104013455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104013455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104013456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104013456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104013457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104013457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104013457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:15.166049 run patchelf(pid=27562): Terminating (SIGINT) 10:40:15.334325 run patchelf(pid=27562): Terminated: ok {rc=0} 10:40:15.455542 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27559): Process ended prematurely: osmo-stp_10.42.42.5(pid=27559) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27559)] [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 10:40:15.465077 tst iperf3.py:8: Test FAILED (7.3 sec) 10:40:15.492247 run osmo-hlr_10.42.42.2(pid=27556): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27556)] 10:40:15.539889 run osmo-hlr_10.42.42.2(pid=27556): stdout: | (launched: 2022-12-09_10:40:12.344744) 10:40:15.589313 run osmo-hlr_10.42.42.2(pid=27556): stderr: | 20221209104012519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104012519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104012519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104012519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104012519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104012519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104012532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104012542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104012542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104012542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:15.639013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27551): Terminating (SIGTERM) 10:40:15.678408 run iperf3-srv_10.42.42.10(pid=27552): Terminating (SIGTERM) 10:40:15.717662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27555): Terminating (SIGTERM) 10:40:15.757060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27558): Terminating (SIGTERM) 10:40:15.796695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27561): Terminating (SIGTERM) 10:40:15.841494 --- ParallelTerminationStrategy: PID 27551 died... 10:40:15.869524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27551): Terminated: ok {rc=0} 10:40:15.920769 --- ParallelTerminationStrategy: PID 27552 died... 10:40:15.940603 run iperf3-srv_10.42.42.10(pid=27552): Terminated {rc=256} 10:40:15.986033 --- ParallelTerminationStrategy: PID 27555 died... 10:40:16.005783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27555): Terminated: ok {rc=0} 10:40:16.055159 --- ParallelTerminationStrategy: PID 27558 died... 10:40:16.079155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27558): Terminated: ok {rc=0} 10:40:16.133582 --- ParallelTerminationStrategy: PID 27561 died... 10:40:16.157110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27561): Terminated: ok {rc=0} 10:40:16.262249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:40:17.417211 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:17.428273 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:40:17.479404 tst iperf3m4.py: using LAC 20895 10:40:17.599583 tst iperf3m4.py: using RAC 240 10:40:17.719188 tst iperf3m4.py: using CellId 20895 10:40:17.839153 tst iperf3m4.py: using BVCI 20896 10:40:17.949701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:17.960353 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:17.971164 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:17.981774 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:17.992243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:18.002861 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:18.013519 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:18.023814 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:18.034448 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:18.150118 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:18.270385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:18.390110 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:18.506379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:40:18.708810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:19.012232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Launched 10:40:19.275706 run iperf3-srv_10.42.42.10(pid=27564): Launched 10:40:19.389571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:40:19.590086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:19.892838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Launched 10:40:20.156152 run iperf3-srv_10.42.42.10(pid=27566): Launched 10:40:20.269436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:40:20.469927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:20.771665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27567): Launched 10:40:21.034289 run iperf3-srv_10.42.42.10(pid=27568): Launched 10:40:21.149132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:40:21.349260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:21.651130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27569): Launched 10:40:21.913365 run iperf3-srv_10.42.42.10(pid=27570): Launched 10:40:22.026728 tst iperf3m4.py:8: start network... 10:40:22.225985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:22.691378 run create_hlr_db(pid=27571): Launched 10:40:22.814853 bus /gobi_6: Setting Powered False 10:40:23.874651 run create_hlr_db(pid=27571): Terminated: ok {rc=0} 10:40:24.314193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Launched 10:40:24.639745 run osmo-hlr_10.42.42.2(pid=27574): Launched 10:40:24.765254 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:25.328106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Launched 10:40:25.651159 run osmo-stp_10.42.42.5(pid=27577): Launched 10:40:25.776418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:26.333637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27579): Launched 10:40:26.457980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:26.732784 run patchelf(pid=27580): Launched 10:40:26.913654 run osmo-stp_10.42.42.5(pid=27577): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] 10:40:27.050742 run osmo-stp_10.42.42.5(pid=27577): stdout: | (launched: 2022-12-09_10:40:25.591972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:27.189349 run osmo-stp_10.42.42.5(pid=27577): stderr: | 20221209104025778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104025779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104025779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104025779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104025780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104025780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104025780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:27.328443 run osmo-stp_10.42.42.5(pid=27577): stdout: | (launched: 2022-12-09_10:40:25.591972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:27.461733 run osmo-stp_10.42.42.5(pid=27577): stderr: | 20221209104025778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104025779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104025779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104025779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104025780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104025780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104025780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:27.619679 run patchelf(pid=27580): Terminating (SIGINT) 10:40:27.800852 run patchelf(pid=27580): Terminated: ok {rc=0} 10:40:27.931468 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27577): Process ended prematurely: osmo-stp_10.42.42.5(pid=27577) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 10:40:27.941674 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:40:27.971352 run osmo-hlr_10.42.42.2(pid=27574): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27574)] 10:40:28.022295 run osmo-hlr_10.42.42.2(pid=27574): stdout: | (launched: 2022-12-09_10:40:24.580647) 10:40:28.075139 run osmo-hlr_10.42.42.2(pid=27574): stderr: | 20221209104024773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104024773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104024773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104024773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104024773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104024773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104024788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104024800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104024800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104024800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:28.128424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Terminating (SIGTERM) 10:40:28.171075 run iperf3-srv_10.42.42.10(pid=27564): Terminating (SIGTERM) 10:40:28.214915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Terminating (SIGTERM) 10:40:28.258188 run iperf3-srv_10.42.42.10(pid=27566): Terminating (SIGTERM) 10:40:28.300919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27567): Terminating (SIGTERM) 10:40:28.343809 run iperf3-srv_10.42.42.10(pid=27568): Terminating (SIGTERM) 10:40:28.386364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27569): Terminating (SIGTERM) 10:40:28.429060 run iperf3-srv_10.42.42.10(pid=27570): Terminating (SIGTERM) 10:40:28.471534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Terminating (SIGTERM) 10:40:28.514272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Terminating (SIGTERM) 10:40:28.556910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27579): Terminating (SIGTERM) 10:40:28.599748 --- ParallelTerminationStrategy: PID 27563 died... 10:40:28.619994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Terminated: ok {rc=0} 10:40:28.667340 --- ParallelTerminationStrategy: PID 27564 died... 10:40:28.686972 run iperf3-srv_10.42.42.10(pid=27564): Terminated {rc=256} 10:40:28.733893 --- ParallelTerminationStrategy: PID 27565 died... 10:40:28.753810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Terminated: ok {rc=0} 10:40:28.800638 --- ParallelTerminationStrategy: PID 27566 died... 10:40:28.820555 run iperf3-srv_10.42.42.10(pid=27566): Terminated {rc=256} 10:40:28.867778 --- ParallelTerminationStrategy: PID 27567 died... 10:40:28.887578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27567): Terminated: ok {rc=0} 10:40:28.935073 --- ParallelTerminationStrategy: PID 27568 died... 10:40:28.954837 run iperf3-srv_10.42.42.10(pid=27568): Terminated {rc=256} 10:40:29.001862 --- ParallelTerminationStrategy: PID 27569 died... 10:40:29.021729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27569): Terminated: ok {rc=0} 10:40:29.068788 --- ParallelTerminationStrategy: PID 27570 died... 10:40:29.088852 run iperf3-srv_10.42.42.10(pid=27570): Terminated {rc=256} 10:40:29.135860 --- ParallelTerminationStrategy: PID 27573 died... 10:40:29.155726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Terminated: ok {rc=0} 10:40:29.202771 --- ParallelTerminationStrategy: PID 27576 died... 10:40:29.222453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Terminated: ok {rc=0} 10:40:29.270179 --- ParallelTerminationStrategy: PID 27579 died... 10:40:29.290037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27579): Terminated: ok {rc=0} 10:40:29.379360 bus /gobi_4: Setting Powered False 10:40:30.478855 bus /gobi_4: Setting Powered False 10:40:31.593280 bus /gobi_1: Setting Powered False 10:40:32.692693 bus /gobi_1: Setting Powered False 10:40:33.808124 bus /gobi_0: Setting Powered False 10:40:34.906882 bus /gobi_0: Setting Powered False 10:40:36.025779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 10:40:37.129815 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.141929 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:40:37.194271 tst ping.py: using LAC 20896 10:40:37.321276 tst ping.py: using RAC 241 10:40:37.448085 tst ping.py: using CellId 20896 10:40:37.574364 tst ping.py: using BVCI 20897 10:40:37.690170 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.701476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.712398 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.723790 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.735110 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.746413 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.758048 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:37.769363 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:37.885330 tst ping.py:19: start network... 10:40:38.082737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:38.544008 run create_hlr_db(pid=27581): Launched 10:40:38.668762 bus /gobi_6: Setting Powered False 10:40:39.728722 run create_hlr_db(pid=27581): Terminated: ok {rc=0} 10:40:40.144776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27583): Launched 10:40:40.442626 run osmo-hlr_10.42.42.2(pid=27584): Launched 10:40:40.555433 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:41.084818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27586): Launched 10:40:41.381967 run osmo-stp_10.42.42.5(pid=27587): Launched 10:40:41.494854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:42.009387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27589): Launched 10:40:42.123028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:42.374802 run patchelf(pid=27590): Launched 10:40:42.539690 run osmo-stp_10.42.42.5(pid=27587): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27587)] 10:40:42.665150 run osmo-stp_10.42.42.5(pid=27587): stdout: | (launched: 2022-12-09_10:40:41.326754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:42.791855 run osmo-stp_10.42.42.5(pid=27587): stderr: | 20221209104041494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104041494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104041494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104041495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104041495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104041495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104041495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:42.918751 run osmo-stp_10.42.42.5(pid=27587): stdout: | (launched: 2022-12-09_10:40:41.326754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:43.039805 run osmo-stp_10.42.42.5(pid=27587): stderr: | 20221209104041494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104041494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104041494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104041495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104041495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104041495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104041495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:43.183944 run patchelf(pid=27590): Terminating (SIGINT) 10:40:43.350284 run patchelf(pid=27590): Terminated: ok {rc=0} 10:40:43.469827 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27587): Process ended prematurely: osmo-stp_10.42.42.5(pid=27587) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27587)] [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 10:40:43.478813 tst ping.py:22: Test FAILED (6.3 sec) 10:40:43.505768 run osmo-hlr_10.42.42.2(pid=27584): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27584)] 10:40:43.553313 run osmo-hlr_10.42.42.2(pid=27584): stdout: | (launched: 2022-12-09_10:40:40.387451) 10:40:43.602461 run osmo-hlr_10.42.42.2(pid=27584): stderr: | 20221209104040561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104040561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104040561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104040561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104040561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104040561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104040573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104040582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104040582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104040582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:43.652130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27583): Terminating (SIGTERM) 10:40:43.692148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27586): Terminating (SIGTERM) 10:40:43.732117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27589): Terminating (SIGTERM) 10:40:43.772380 --- ParallelTerminationStrategy: PID 27583 died... 10:40:43.791687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27583): Terminated: ok {rc=0} 10:40:43.835812 --- ParallelTerminationStrategy: PID 27586 died... 10:40:43.854643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27586): Terminated: ok {rc=0} 10:40:43.898534 --- ParallelTerminationStrategy: PID 27589 died... 10:40:43.917452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27589): Terminated: ok {rc=0} 10:40:44.001186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:40:45.087316 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.099707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:40:45.154877 tst ping_idle_ping.py: using LAC 20897 10:40:45.281798 tst ping_idle_ping.py: using RAC 242 10:40:45.409249 tst ping_idle_ping.py: using CellId 20897 10:40:45.533988 tst ping_idle_ping.py: using BVCI 20898 10:40:45.652125 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.663701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.674842 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.686688 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.698412 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.710257 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.722265 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:40:45.734274 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:40:45.860347 tst ping_idle_ping.py:24: start network... 10:40:46.075240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:46.558536 run create_hlr_db(pid=27591): Launched 10:40:46.712466 bus /gobi_6: Setting Powered False 10:40:47.775979 run create_hlr_db(pid=27591): Terminated: ok {rc=0} 10:40:48.220136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27593): Launched 10:40:48.538861 run osmo-hlr_10.42.42.2(pid=27594): Launched 10:40:48.661452 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:49.215780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27596): Launched 10:40:49.534617 run osmo-stp_10.42.42.5(pid=27597): Launched 10:40:49.657596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:50.206977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27599): Launched 10:40:50.332063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:50.600436 run patchelf(pid=27600): Launched 10:40:50.779320 run osmo-stp_10.42.42.5(pid=27597): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27597)] 10:40:50.914007 run osmo-stp_10.42.42.5(pid=27597): stdout: | (launched: 2022-12-09_10:40:49.475907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:51.049790 run osmo-stp_10.42.42.5(pid=27597): stderr: | 20221209104049664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104049665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104049665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104049665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104049666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104049666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104049666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:51.185608 run osmo-stp_10.42.42.5(pid=27597): stdout: | (launched: 2022-12-09_10:40:49.475907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:51.316657 run osmo-stp_10.42.42.5(pid=27597): stderr: | 20221209104049664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104049665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104049665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104049665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104049666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104049666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104049666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:51.470956 run patchelf(pid=27600): Terminating (SIGINT) 10:40:51.648698 run patchelf(pid=27600): Terminated: ok {rc=0} 10:40:51.777266 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27597): Process ended prematurely: osmo-stp_10.42.42.5(pid=27597) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27597)] [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 10:40:51.786900 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:40:51.816016 run osmo-hlr_10.42.42.2(pid=27594): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27594)] 10:40:51.866382 run osmo-hlr_10.42.42.2(pid=27594): stdout: | (launched: 2022-12-09_10:40:48.480489) 10:40:51.918350 run osmo-hlr_10.42.42.2(pid=27594): stderr: | 20221209104048676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104048676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104048676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104048676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104048676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104048676 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104048688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104048696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104048696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104048696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:51.970692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27593): Terminating (SIGTERM) 10:40:52.012713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27596): Terminating (SIGTERM) 10:40:52.054941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27599): Terminating (SIGTERM) 10:40:52.097752 --- ParallelTerminationStrategy: PID 27593 died... 10:40:52.117951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27593): Terminated: ok {rc=0} 10:40:52.164879 --- ParallelTerminationStrategy: PID 27596 died... 10:40:52.184795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27596): Terminated: ok {rc=0} 10:40:52.231888 --- ParallelTerminationStrategy: PID 27599 died... 10:40:52.252130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27599): Terminated: ok {rc=0} 10:40:52.342460 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:40:53.648796 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:53.655902 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:40:53.690768 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:40:53.730129 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:40:53.818216 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:40:53.852269 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:40:53.891538 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:40:54.484712 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:40:54.537693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:54.548880 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:40:54.623473 tst cs_paging_gprs_active.py: using LAC 20898 10:40:54.750515 tst cs_paging_gprs_active.py: using RAC 243 10:40:54.877746 tst cs_paging_gprs_active.py: using CellId 20898 10:40:55.005550 tst cs_paging_gprs_active.py: using BVCI 20899 10:40:55.116311 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.127319 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.138253 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.149038 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.159697 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.170355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.181116 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.191437 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:40:55.202108 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:40:55.322278 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:40:55.438403 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:40:55.641763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:55.946802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27606): Launched 10:40:56.212535 run iperf3-srv_10.42.42.10(pid=27607): Launched 10:40:56.327013 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:40:56.529072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:56.833312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27608): Launched 10:40:57.097183 run iperf3-srv_10.42.42.10(pid=27609): Launched 10:40:57.210823 tst cs_paging_gprs_active.py:38: start network... 10:40:57.412930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:57.881800 run create_hlr_db(pid=27610): Launched 10:40:58.007846 bus /gobi_6: Setting Powered False 10:40:59.067504 run create_hlr_db(pid=27610): Terminated: ok {rc=0} 10:40:59.508637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27612): Launched 10:40:59.833714 run osmo-hlr_10.42.42.2(pid=27613): Launched 10:40:59.958743 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:00.513609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27615): Launched 10:41:00.858114 run osmo-stp_10.42.42.5(pid=27616): Launched 10:41:01.120834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:01.727472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27618): Launched 10:41:01.892379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:02.179482 run patchelf(pid=27619): Launched 10:41:02.376172 run osmo-stp_10.42.42.5(pid=27616): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27616)] 10:41:02.514415 run osmo-stp_10.42.42.5(pid=27616): stdout: | (launched: 2022-12-09_10:41:00.780578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:02.653536 run osmo-stp_10.42.42.5(pid=27616): stderr: | 20221209104101059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104101059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104101060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104101060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104101062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104101062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104101062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:02.793134 run osmo-stp_10.42.42.5(pid=27616): stdout: | (launched: 2022-12-09_10:41:00.780578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:02.926772 run osmo-stp_10.42.42.5(pid=27616): stderr: | 20221209104101059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104101059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104101060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104101060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104101062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104101062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104101062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:03.085862 run patchelf(pid=27619): Terminating (SIGINT) 10:41:03.268566 run patchelf(pid=27619): Terminated: ok {rc=0} 10:41:03.400885 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27616): Process ended prematurely: osmo-stp_10.42.42.5(pid=27616) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27616)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:41:03.411256 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:41:03.440609 run osmo-hlr_10.42.42.2(pid=27613): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27613)] 10:41:03.492178 run osmo-hlr_10.42.42.2(pid=27613): stdout: | (launched: 2022-12-09_10:40:59.774309) 10:41:03.545078 run osmo-hlr_10.42.42.2(pid=27613): stderr: | 20221209104059969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104059969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104059969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104059969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104059969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104059969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104059980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104059989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104059989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104059989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:03.598424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27606): Terminating (SIGTERM) 10:41:03.641279 run iperf3-srv_10.42.42.10(pid=27607): Terminating (SIGTERM) 10:41:03.684168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27608): Terminating (SIGTERM) 10:41:03.727098 run iperf3-srv_10.42.42.10(pid=27609): Terminating (SIGTERM) 10:41:03.769581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27612): Terminating (SIGTERM) 10:41:03.812235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27615): Terminating (SIGTERM) 10:41:03.854834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27618): Terminating (SIGTERM) 10:41:03.897792 --- ParallelTerminationStrategy: PID 27606 died... 10:41:03.917717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27606): Terminated: ok {rc=0} 10:41:03.965255 --- ParallelTerminationStrategy: PID 27607 died... 10:41:03.985149 run iperf3-srv_10.42.42.10(pid=27607): Terminated {rc=256} 10:41:04.032370 --- ParallelTerminationStrategy: PID 27608 died... 10:41:04.052367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27608): Terminated: ok {rc=0} 10:41:04.099631 --- ParallelTerminationStrategy: PID 27609 died... 10:41:04.119448 run iperf3-srv_10.42.42.10(pid=27609): Terminated {rc=256} 10:41:04.166643 --- ParallelTerminationStrategy: PID 27612 died... 10:41:04.186588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27612): Terminated: ok {rc=0} 10:41:04.234044 --- ParallelTerminationStrategy: PID 27615 died... 10:41:04.253890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27615): Terminated: ok {rc=0} 10:41:04.301270 --- ParallelTerminationStrategy: PID 27618 died... 10:41:04.321158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27618): Terminated: ok {rc=0} 10:41:04.409864 bus /gobi_0: Setting Powered False 10:41:05.510722 bus /gobi_0: Setting Powered False 10:41:06.627125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:41:07.777303 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:07.789211 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:41:07.861365 tst iperf3.py: using LAC 20899 10:41:07.987704 tst iperf3.py: using RAC 244 10:41:08.119778 tst iperf3.py: using CellId 20899 10:41:08.245381 tst iperf3.py: using BVCI 20900 10:41:08.363902 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.375195 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.386398 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.397808 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.409176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.420470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.431946 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.442853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:08.455330 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:08.571998 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:41:08.774727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:09.079584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27620): Launched 10:41:09.343857 run iperf3-srv_10.42.42.10(pid=27621): Launched 10:41:09.457144 tst iperf3.py:8: start network... 10:41:09.657626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:10.128080 run create_hlr_db(pid=27622): Launched 10:41:10.252674 bus /gobi_6: Setting Powered False 10:41:11.313388 run create_hlr_db(pid=27622): Terminated: ok {rc=0} 10:41:11.754301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27624): Launched 10:41:12.079011 run osmo-hlr_10.42.42.2(pid=27625): Launched 10:41:12.204366 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:12.762563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27627): Launched 10:41:13.087936 run osmo-stp_10.42.42.5(pid=27628): Launched 10:41:13.212486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:13.771250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27630): Launched 10:41:13.897208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:14.171160 run patchelf(pid=27631): Launched 10:41:14.353425 run osmo-stp_10.42.42.5(pid=27628): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27628)] 10:41:14.489950 run osmo-stp_10.42.42.5(pid=27628): stdout: | (launched: 2022-12-09_10:41:13.028421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:14.627788 run osmo-stp_10.42.42.5(pid=27628): stderr: | 20221209104113216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104113217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104113217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104113217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104113218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104113218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104113218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:14.766246 run osmo-stp_10.42.42.5(pid=27628): stdout: | (launched: 2022-12-09_10:41:13.028421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:14.898888 run osmo-stp_10.42.42.5(pid=27628): stderr: | 20221209104113216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104113217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104113217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104113217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104113218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104113218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104113218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:15.056095 run patchelf(pid=27631): Terminating (SIGINT) 10:41:15.237235 run patchelf(pid=27631): Terminated: ok {rc=0} 10:41:15.368180 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27628): Process ended prematurely: osmo-stp_10.42.42.5(pid=27628) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27628)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 10:41:15.378452 tst iperf3.py:8: Test FAILED (7.6 sec) 10:41:15.407440 run osmo-hlr_10.42.42.2(pid=27625): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27625)] 10:41:15.457947 run osmo-hlr_10.42.42.2(pid=27625): stdout: | (launched: 2022-12-09_10:41:12.019591) 10:41:15.509970 run osmo-hlr_10.42.42.2(pid=27625): stderr: | 20221209104112212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104112212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104112212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104112212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104112212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104112212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104112226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104112235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104112235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104112235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:15.562472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27620): Terminating (SIGTERM) 10:41:15.604290 run iperf3-srv_10.42.42.10(pid=27621): Terminating (SIGTERM) 10:41:15.646226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27624): Terminating (SIGTERM) 10:41:15.688257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27627): Terminating (SIGTERM) 10:41:15.730111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27630): Terminating (SIGTERM) 10:41:15.772338 --- ParallelTerminationStrategy: PID 27620 died... 10:41:15.792227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27620): Terminated: ok {rc=0} 10:41:15.839432 --- ParallelTerminationStrategy: PID 27621 died... 10:41:15.873986 run iperf3-srv_10.42.42.10(pid=27621): Terminated {rc=256} 10:41:15.921365 --- ParallelTerminationStrategy: PID 27624 died... 10:41:15.941249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27624): Terminated: ok {rc=0} 10:41:15.988916 --- ParallelTerminationStrategy: PID 27627 died... 10:41:16.008805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27627): Terminated: ok {rc=0} 10:41:16.057864 --- ParallelTerminationStrategy: PID 27630 died... 10:41:16.078426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27630): Terminated: ok {rc=0} 10:41:16.167891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:41:17.325670 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.337223 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:41:17.407571 tst iperf3m4.py: using LAC 20900 10:41:17.537042 tst iperf3m4.py: using RAC 245 10:41:17.660261 tst iperf3m4.py: using CellId 20900 10:41:17.787767 tst iperf3m4.py: using BVCI 20901 10:41:17.900385 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.911551 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.922423 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.933935 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.945280 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.956614 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.968130 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.979326 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:17.990881 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:18.112019 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:18.232492 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:18.353226 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:18.472824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:41:18.691328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:19.017352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27632): Launched 10:41:19.301048 run iperf3-srv_10.42.42.10(pid=27633): Launched 10:41:19.423048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:41:19.640340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:19.966003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27634): Launched 10:41:20.250036 run iperf3-srv_10.42.42.10(pid=27635): Launched 10:41:20.373905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:41:20.590783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:20.916052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27636): Launched 10:41:21.199774 run iperf3-srv_10.42.42.10(pid=27637): Launched 10:41:21.322965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:41:21.539740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:21.864575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27638): Launched 10:41:22.147060 run iperf3-srv_10.42.42.10(pid=27639): Launched 10:41:22.270772 tst iperf3m4.py:8: start network... 10:41:22.488581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:22.993038 run create_hlr_db(pid=27640): Launched 10:41:23.116874 bus /gobi_6: Setting Powered False 10:41:24.181563 run create_hlr_db(pid=27640): Terminated: ok {rc=0} 10:41:24.613721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27642): Launched 10:41:24.915411 run osmo-hlr_10.42.42.2(pid=27643): Launched 10:41:25.032732 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:25.556888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27645): Launched 10:41:25.858679 run osmo-stp_10.42.42.5(pid=27646): Launched 10:41:25.973396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:26.493293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27648): Launched 10:41:26.609145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:26.864169 run patchelf(pid=27649): Launched 10:41:27.032283 run osmo-stp_10.42.42.5(pid=27646): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27646)] 10:41:27.159289 run osmo-stp_10.42.42.5(pid=27646): stdout: | (launched: 2022-12-09_10:41:25.802768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:27.287839 run osmo-stp_10.42.42.5(pid=27646): stderr: | 20221209104125968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104125968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104125969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104125969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104125970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104125970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104125970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:27.416602 run osmo-stp_10.42.42.5(pid=27646): stdout: | (launched: 2022-12-09_10:41:25.802768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:27.540174 run osmo-stp_10.42.42.5(pid=27646): stderr: | 20221209104125968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104125968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104125969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104125969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104125970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104125970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104125970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:27.686253 run patchelf(pid=27649): Terminating (SIGINT) 10:41:27.854897 run patchelf(pid=27649): Terminated: ok {rc=0} 10:41:27.976730 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27646): Process ended prematurely: osmo-stp_10.42.42.5(pid=27646) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27646)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:41:27.986337 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:41:28.014075 run osmo-hlr_10.42.42.2(pid=27643): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27643)] 10:41:28.061808 run osmo-hlr_10.42.42.2(pid=27643): stdout: | (launched: 2022-12-09_10:41:24.859595) 10:41:28.111487 run osmo-hlr_10.42.42.2(pid=27643): stderr: | 20221209104125031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104125031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104125031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104125031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104125031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104125031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104125043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104125051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104125052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104125052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:28.161413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27632): Terminating (SIGTERM) 10:41:28.201536 run iperf3-srv_10.42.42.10(pid=27633): Terminating (SIGTERM) 10:41:28.241337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27634): Terminating (SIGTERM) 10:41:28.281757 run iperf3-srv_10.42.42.10(pid=27635): Terminating (SIGTERM) 10:41:28.321699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27636): Terminating (SIGTERM) 10:41:28.361743 run iperf3-srv_10.42.42.10(pid=27637): Terminating (SIGTERM) 10:41:28.401689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27638): Terminating (SIGTERM) 10:41:28.441505 run iperf3-srv_10.42.42.10(pid=27639): Terminating (SIGTERM) 10:41:28.481042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27642): Terminating (SIGTERM) 10:41:28.520756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27645): Terminating (SIGTERM) 10:41:28.561425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27648): Terminating (SIGTERM) 10:41:28.601529 --- ParallelTerminationStrategy: PID 27632 died... 10:41:28.620458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27632): Terminated: ok {rc=0} 10:41:28.664526 --- ParallelTerminationStrategy: PID 27633 died... 10:41:28.683172 run iperf3-srv_10.42.42.10(pid=27633): Terminated {rc=256} 10:41:28.727339 --- ParallelTerminationStrategy: PID 27634 died... 10:41:28.746041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27634): Terminated: ok {rc=0} 10:41:28.790364 --- ParallelTerminationStrategy: PID 27635 died... 10:41:28.809118 run iperf3-srv_10.42.42.10(pid=27635): Terminated {rc=256} 10:41:28.852844 --- ParallelTerminationStrategy: PID 27636 died... 10:41:28.871910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27636): Terminated: ok {rc=0} 10:41:28.915972 --- ParallelTerminationStrategy: PID 27637 died... 10:41:28.934638 run iperf3-srv_10.42.42.10(pid=27637): Terminated {rc=256} 10:41:28.979065 --- ParallelTerminationStrategy: PID 27638 died... 10:41:28.997858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27638): Terminated: ok {rc=0} 10:41:29.041927 --- ParallelTerminationStrategy: PID 27639 died... 10:41:29.060618 run iperf3-srv_10.42.42.10(pid=27639): Terminated {rc=256} 10:41:29.104476 --- ParallelTerminationStrategy: PID 27642 died... 10:41:29.123242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27642): Terminated: ok {rc=0} 10:41:29.167242 --- ParallelTerminationStrategy: PID 27645 died... 10:41:29.186096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27645): Terminated: ok {rc=0} 10:41:29.230622 --- ParallelTerminationStrategy: PID 27648 died... 10:41:29.249395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27648): Terminated: ok {rc=0} 10:41:29.334910 bus /gobi_4: Setting Powered False 10:41:30.436489 bus /gobi_4: Setting Powered False 10:41:31.570366 bus /gobi_1: Setting Powered False 10:41:32.672661 bus /gobi_1: Setting Powered False 10:41:33.790305 bus /gobi_0: Setting Powered False 10:41:34.889366 bus /gobi_0: Setting Powered False 10:41:36.005641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:41:37.112063 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.124176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:41:37.198295 tst ping.py: using LAC 20901 10:41:37.318693 tst ping.py: using RAC 246 10:41:37.435487 tst ping.py: using CellId 20901 10:41:37.550727 tst ping.py: using BVCI 20902 10:41:37.658505 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.669725 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.680557 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.691592 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.702188 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.713252 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.724042 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:37.734811 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:37.848207 tst ping.py:19: start network... 10:41:38.044089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:38.505081 run create_hlr_db(pid=27650): Launched 10:41:38.628325 bus /gobi_6: Setting Powered False 10:41:39.691095 run create_hlr_db(pid=27650): Terminated: ok {rc=0} 10:41:40.135767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27652): Launched 10:41:40.455893 run osmo-hlr_10.42.42.2(pid=27653): Launched 10:41:40.577671 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:41.133698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27655): Launched 10:41:41.454084 run osmo-stp_10.42.42.5(pid=27656): Launched 10:41:41.577482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:42.126600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27658): Launched 10:41:42.250433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:42.519359 run patchelf(pid=27659): Launched 10:41:42.698810 run osmo-stp_10.42.42.5(pid=27656): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27656)] 10:41:42.833444 run osmo-stp_10.42.42.5(pid=27656): stdout: | (launched: 2022-12-09_10:41:41.394728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:42.969238 run osmo-stp_10.42.42.5(pid=27656): stderr: | 20221209104141581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104141581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104141581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104141582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104141582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104141582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104141582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:43.105057 run osmo-stp_10.42.42.5(pid=27656): stdout: | (launched: 2022-12-09_10:41:41.394728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:43.235176 run osmo-stp_10.42.42.5(pid=27656): stderr: | 20221209104141581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104141581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104141581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104141582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104141582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104141582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104141582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:43.389837 run patchelf(pid=27659): Terminating (SIGINT) 10:41:43.568005 run patchelf(pid=27659): Terminated: ok {rc=0} 10:41:43.696335 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27656): Process ended prematurely: osmo-stp_10.42.42.5(pid=27656) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27656)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 10:41:43.706024 tst ping.py:22: Test FAILED (6.6 sec) 10:41:43.735110 run osmo-hlr_10.42.42.2(pid=27653): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27653)] 10:41:43.785944 run osmo-hlr_10.42.42.2(pid=27653): stdout: | (launched: 2022-12-09_10:41:40.396486) 10:41:43.838446 run osmo-hlr_10.42.42.2(pid=27653): stderr: | 20221209104140590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104140590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104140590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104140590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104140590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104140590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104140603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104140612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104140612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104140612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:43.891453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27652): Terminating (SIGTERM) 10:41:43.934037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27655): Terminating (SIGTERM) 10:41:43.977044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27658): Terminating (SIGTERM) 10:41:44.019755 --- ParallelTerminationStrategy: PID 27652 died... 10:41:44.039999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27652): Terminated: ok {rc=0} 10:41:44.087393 --- ParallelTerminationStrategy: PID 27655 died... 10:41:44.107192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27655): Terminated: ok {rc=0} 10:41:44.154237 --- ParallelTerminationStrategy: PID 27658 died... 10:41:44.174002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27658): Terminated: ok {rc=0} 10:41:44.264603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:41:45.352575 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:45.365104 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:41:45.438588 tst ping_idle_ping.py: using LAC 20902 10:41:45.565433 tst ping_idle_ping.py: using RAC 247 10:41:45.685471 tst ping_idle_ping.py: using CellId 20902 10:41:45.802922 tst ping_idle_ping.py: using BVCI 20903 10:41:45.928370 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:45.940729 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:45.952836 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:45.966985 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:45.980535 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:45.992825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:46.006336 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:41:46.021757 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:41:46.148141 tst ping_idle_ping.py:24: start network... 10:41:46.352007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:46.828388 run create_hlr_db(pid=27660): Launched 10:41:46.983801 bus /gobi_6: Setting Powered False 10:41:48.045136 run create_hlr_db(pid=27660): Terminated: ok {rc=0} 10:41:48.480572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27662): Launched 10:41:48.801273 run osmo-hlr_10.42.42.2(pid=27663): Launched 10:41:48.923485 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:49.474880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27665): Launched 10:41:49.793862 run osmo-stp_10.42.42.5(pid=27666): Launched 10:41:49.917336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:50.468203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27668): Launched 10:41:50.592416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:50.862579 run patchelf(pid=27669): Launched 10:41:51.042694 run osmo-stp_10.42.42.5(pid=27666): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27666)] 10:41:51.178010 run osmo-stp_10.42.42.5(pid=27666): stdout: | (launched: 2022-12-09_10:41:49.735117) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:51.315071 run osmo-stp_10.42.42.5(pid=27666): stderr: | 20221209104149922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104149922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104149923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104149923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104149923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104149923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104149924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:51.451939 run osmo-stp_10.42.42.5(pid=27666): stdout: | (launched: 2022-12-09_10:41:49.735117) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:51.583045 run osmo-stp_10.42.42.5(pid=27666): stderr: | 20221209104149922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104149922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104149923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104149923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104149923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104149923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104149924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:51.738575 run patchelf(pid=27669): Terminating (SIGINT) 10:41:51.916587 run patchelf(pid=27669): Terminated: ok {rc=0} 10:41:52.045173 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27666): Process ended prematurely: osmo-stp_10.42.42.5(pid=27666) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27666)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:41:52.055396 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:41:52.084627 run osmo-hlr_10.42.42.2(pid=27663): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27663)] 10:41:52.135287 run osmo-hlr_10.42.42.2(pid=27663): stdout: | (launched: 2022-12-09_10:41:48.742648) 10:41:52.187625 run osmo-hlr_10.42.42.2(pid=27663): stderr: | 20221209104148936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104148936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104148936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104148936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104148936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104148936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104148950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104148958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104148958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104148958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:52.240499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27662): Terminating (SIGTERM) 10:41:52.283162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27665): Terminating (SIGTERM) 10:41:52.326002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27668): Terminating (SIGTERM) 10:41:52.368857 --- ParallelTerminationStrategy: PID 27662 died... 10:41:52.389243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27662): Terminated: ok {rc=0} 10:41:52.436620 --- ParallelTerminationStrategy: PID 27665 died... 10:41:52.456541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27665): Terminated: ok {rc=0} 10:41:52.503449 --- ParallelTerminationStrategy: PID 27668 died... 10:41:52.523267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27668): Terminated: ok {rc=0} 10:41:52.611909 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:41:53.924253 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:53.931016 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:41:53.965659 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:41:54.005093 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:41:54.092334 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:41:54.125134 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:41:54.162859 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:41:54.759886 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:41:54.814501 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:54.826002 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:41:54.897354 tst cs_paging_gprs_active.py: using LAC 20903 10:41:55.022911 tst cs_paging_gprs_active.py: using RAC 248 10:41:55.149332 tst cs_paging_gprs_active.py: using CellId 20903 10:41:55.276761 tst cs_paging_gprs_active.py: using BVCI 20904 10:41:55.395964 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.407195 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.418265 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.429661 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.440869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.453078 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.464568 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.476319 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:41:55.487788 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:41:55.606179 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:41:55.731179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:41:55.950740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:56.277855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27673): Launched 10:41:56.563343 run iperf3-srv_10.42.42.10(pid=27674): Launched 10:41:56.687906 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:41:56.906193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:57.232239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27675): Launched 10:41:57.517407 run iperf3-srv_10.42.42.10(pid=27676): Launched 10:41:57.640689 tst cs_paging_gprs_active.py:38: start network... 10:41:57.860356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:58.367083 run create_hlr_db(pid=27677): Launched 10:41:58.493737 bus /gobi_6: Setting Powered False 10:41:59.558203 run create_hlr_db(pid=27677): Terminated: ok {rc=0} 10:42:00.009900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27679): Launched 10:42:00.336763 run osmo-hlr_10.42.42.2(pid=27680): Launched 10:42:00.461140 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:01.148314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27692): Launched 10:42:01.549797 run osmo-stp_10.42.42.5(pid=27693): Launched 10:42:01.701024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:02.353607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27695): Launched 10:42:02.479313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:02.754841 run patchelf(pid=27696): Launched 10:42:02.939366 run osmo-stp_10.42.42.5(pid=27693): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27693)] 10:42:03.076329 run osmo-stp_10.42.42.5(pid=27693): stdout: | (launched: 2022-12-09_10:42:01.482799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:03.215202 run osmo-stp_10.42.42.5(pid=27693): stderr: | 20221209104201829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104201829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104201829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104201834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104201835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104201835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104201841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:03.354717 run osmo-stp_10.42.42.5(pid=27693): stdout: | (launched: 2022-12-09_10:42:01.482799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:03.488273 run osmo-stp_10.42.42.5(pid=27693): stderr: | 20221209104201829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104201829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104201829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104201834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104201835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104201835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104201841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:03.645932 run patchelf(pid=27696): Terminating (SIGINT) 10:42:03.827715 run patchelf(pid=27696): Terminated: ok {rc=0} 10:42:03.958720 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27693): Process ended prematurely: osmo-stp_10.42.42.5(pid=27693) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27693)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:42:03.968894 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 10:42:03.998378 run osmo-hlr_10.42.42.2(pid=27680): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27680)] 10:42:04.049160 run osmo-hlr_10.42.42.2(pid=27680): stdout: | (launched: 2022-12-09_10:42:00.276713) 10:42:04.101504 run osmo-hlr_10.42.42.2(pid=27680): stderr: | 20221209104200472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104200472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104200472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104200472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104200472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104200472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104200485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104200493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104200493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104200493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:04.154444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27673): Terminating (SIGTERM) 10:42:04.196484 run iperf3-srv_10.42.42.10(pid=27674): Terminating (SIGTERM) 10:42:04.238344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27675): Terminating (SIGTERM) 10:42:04.280270 run iperf3-srv_10.42.42.10(pid=27676): Terminating (SIGTERM) 10:42:04.322485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27679): Terminating (SIGTERM) 10:42:04.364454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27692): Terminating (SIGTERM) 10:42:04.406407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27695): Terminating (SIGTERM) 10:42:04.448633 --- ParallelTerminationStrategy: PID 27673 died... 10:42:04.468704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27673): Terminated: ok {rc=0} 10:42:04.515213 --- ParallelTerminationStrategy: PID 27674 died... 10:42:04.534590 run iperf3-srv_10.42.42.10(pid=27674): Terminated {rc=256} 10:42:04.580833 --- ParallelTerminationStrategy: PID 27675 died... 10:42:04.600711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27675): Terminated: ok {rc=0} 10:42:04.646945 --- ParallelTerminationStrategy: PID 27676 died... 10:42:04.666390 run iperf3-srv_10.42.42.10(pid=27676): Terminated {rc=256} 10:42:04.712494 --- ParallelTerminationStrategy: PID 27679 died... 10:42:04.731969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27679): Terminated: ok {rc=0} 10:42:04.778248 --- ParallelTerminationStrategy: PID 27692 died... 10:42:04.797746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27692): Terminated: ok {rc=0} 10:42:04.843976 --- ParallelTerminationStrategy: PID 27695 died... 10:42:04.863533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27695): Terminated: ok {rc=0} 10:42:04.951361 bus /gobi_0: Setting Powered False 10:42:06.050344 bus /gobi_0: Setting Powered False 10:42:07.165562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:42:08.313676 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.325855 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:42:08.398377 tst iperf3.py: using LAC 20904 10:42:08.527044 tst iperf3.py: using RAC 249 10:42:08.654326 tst iperf3.py: using CellId 20904 10:42:08.781319 tst iperf3.py: using BVCI 20905 10:42:08.899542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.910774 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.921888 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.933191 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.944416 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.955806 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.966990 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.977996 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:08.989868 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:09.108674 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:42:09.310464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:09.614792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27697): Launched 10:42:09.882245 run iperf3-srv_10.42.42.10(pid=27698): Launched 10:42:09.996053 tst iperf3.py:8: start network... 10:42:10.198218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:10.670256 run create_hlr_db(pid=27699): Launched 10:42:10.799019 bus /gobi_6: Setting Powered False 10:42:11.860278 run create_hlr_db(pid=27699): Terminated: ok {rc=0} 10:42:12.304922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27701): Launched 10:42:12.631216 run osmo-hlr_10.42.42.2(pid=27702): Launched 10:42:12.758428 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:13.319921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27704): Launched 10:42:13.645996 run osmo-stp_10.42.42.5(pid=27705): Launched 10:42:13.773733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:14.337473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27707): Launched 10:42:14.463809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:14.740118 run patchelf(pid=27708): Launched 10:42:14.923705 run osmo-stp_10.42.42.5(pid=27705): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27705)] 10:42:15.063304 run osmo-stp_10.42.42.5(pid=27705): stdout: | (launched: 2022-12-09_10:42:13.585516) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:15.203899 run osmo-stp_10.42.42.5(pid=27705): stderr: | 20221209104213772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104213772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104213772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104213773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104213773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104213773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104213773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:15.343715 run osmo-stp_10.42.42.5(pid=27705): stdout: | (launched: 2022-12-09_10:42:13.585516) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:15.477181 run osmo-stp_10.42.42.5(pid=27705): stderr: | 20221209104213772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104213772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104213772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104213773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104213773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104213773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104213773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:15.635459 run patchelf(pid=27708): Terminating (SIGINT) 10:42:15.816863 run patchelf(pid=27708): Terminated: ok {rc=0} 10:42:15.978520 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27705): Process ended prematurely: osmo-stp_10.42.42.5(pid=27705) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27705)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 10:42:15.990010 tst iperf3.py:8: Test FAILED (7.7 sec) 10:42:16.022707 run osmo-hlr_10.42.42.2(pid=27702): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27702)] 10:42:16.077731 run osmo-hlr_10.42.42.2(pid=27702): stdout: | (launched: 2022-12-09_10:42:12.571583) 10:42:16.132832 run osmo-hlr_10.42.42.2(pid=27702): stderr: | 20221209104212765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104212766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104212766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104212766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104212766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104212766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104212779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104212789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104212789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104212789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:16.188207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27697): Terminating (SIGTERM) 10:42:16.233443 run iperf3-srv_10.42.42.10(pid=27698): Terminating (SIGTERM) 10:42:16.280702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27701): Terminating (SIGTERM) 10:42:16.326792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27704): Terminating (SIGTERM) 10:42:16.373938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27707): Terminating (SIGTERM) 10:42:16.419410 --- ParallelTerminationStrategy: PID 27697 died... 10:42:16.440342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27697): Terminated: ok {rc=0} 10:42:16.490781 --- ParallelTerminationStrategy: PID 27698 died... 10:42:16.511694 run iperf3-srv_10.42.42.10(pid=27698): Terminated {rc=256} 10:42:16.562071 --- ParallelTerminationStrategy: PID 27701 died... 10:42:16.583373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27701): Terminated: ok {rc=0} 10:42:16.634056 --- ParallelTerminationStrategy: PID 27704 died... 10:42:16.655042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27704): Terminated: ok {rc=0} 10:42:16.705549 --- ParallelTerminationStrategy: PID 27707 died... 10:42:16.726607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27707): Terminated: ok {rc=0} 10:42:16.834585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:42:17.999960 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.011497 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:42:18.081885 tst iperf3m4.py: using LAC 20905 10:42:18.202246 tst iperf3m4.py: using RAC 250 10:42:18.321724 tst iperf3m4.py: using CellId 20905 10:42:18.442586 tst iperf3m4.py: using BVCI 20906 10:42:18.554419 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.565430 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.576131 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.586803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.597336 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.607889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.618712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.629231 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:18.640267 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:18.760137 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:18.878493 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:18.999005 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:19.117217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:42:19.321790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:19.627449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27709): Launched 10:42:19.893275 run iperf3-srv_10.42.42.10(pid=27710): Launched 10:42:20.007727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:42:20.209247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:20.514636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27711): Launched 10:42:20.779563 run iperf3-srv_10.42.42.10(pid=27712): Launched 10:42:20.893338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:42:21.094325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:21.397627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27713): Launched 10:42:21.663477 run iperf3-srv_10.42.42.10(pid=27714): Launched 10:42:21.787446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:42:22.006921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:22.335207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27715): Launched 10:42:22.621448 run iperf3-srv_10.42.42.10(pid=27716): Launched 10:42:22.746152 tst iperf3m4.py:8: start network... 10:42:22.964007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:23.469133 run create_hlr_db(pid=27717): Launched 10:42:23.594478 bus /gobi_6: Setting Powered False 10:42:24.658726 run create_hlr_db(pid=27717): Terminated: ok {rc=0} 10:42:25.092075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27719): Launched 10:42:25.395140 run osmo-hlr_10.42.42.2(pid=27720): Launched 10:42:25.511435 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:26.049774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27722): Launched 10:42:26.352071 run osmo-stp_10.42.42.5(pid=27723): Launched 10:42:26.466492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:26.987789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27725): Launched 10:42:27.104281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:27.360588 run patchelf(pid=27726): Launched 10:42:27.529671 run osmo-stp_10.42.42.5(pid=27723): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27723)] 10:42:27.657621 run osmo-stp_10.42.42.5(pid=27723): stdout: | (launched: 2022-12-09_10:42:26.295832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:27.786696 run osmo-stp_10.42.42.5(pid=27723): stderr: | 20221209104226465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104226465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104226466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104226466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104226467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104226467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104226467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:27.915690 run osmo-stp_10.42.42.5(pid=27723): stdout: | (launched: 2022-12-09_10:42:26.295832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:28.039571 run osmo-stp_10.42.42.5(pid=27723): stderr: | 20221209104226465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104226465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104226466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104226466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104226467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104226467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104226467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:28.186465 run patchelf(pid=27726): Terminating (SIGINT) 10:42:28.356028 run patchelf(pid=27726): Terminated: ok {rc=0} 10:42:28.478437 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27723): Process ended prematurely: osmo-stp_10.42.42.5(pid=27723) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27723)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:42:28.487926 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:42:28.515712 run osmo-hlr_10.42.42.2(pid=27720): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27720)] 10:42:28.563716 run osmo-hlr_10.42.42.2(pid=27720): stdout: | (launched: 2022-12-09_10:42:25.338832) 10:42:28.613472 run osmo-hlr_10.42.42.2(pid=27720): stderr: | 20221209104225513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104225513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104225513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104225513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104225513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104225513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104225525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104225534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104225534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104225534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:28.663697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27709): Terminating (SIGTERM) 10:42:28.703859 run iperf3-srv_10.42.42.10(pid=27710): Terminating (SIGTERM) 10:42:28.743926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27711): Terminating (SIGTERM) 10:42:28.784112 run iperf3-srv_10.42.42.10(pid=27712): Terminating (SIGTERM) 10:42:28.824142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27713): Terminating (SIGTERM) 10:42:28.863968 run iperf3-srv_10.42.42.10(pid=27714): Terminating (SIGTERM) 10:42:28.903742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27715): Terminating (SIGTERM) 10:42:28.943604 run iperf3-srv_10.42.42.10(pid=27716): Terminating (SIGTERM) 10:42:28.983385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27719): Terminating (SIGTERM) 10:42:29.024136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27722): Terminating (SIGTERM) 10:42:29.064331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27725): Terminating (SIGTERM) 10:42:29.104641 --- ParallelTerminationStrategy: PID 27709 died... 10:42:29.123894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27709): Terminated: ok {rc=0} 10:42:29.168336 --- ParallelTerminationStrategy: PID 27710 died... 10:42:29.187150 run iperf3-srv_10.42.42.10(pid=27710): Terminated {rc=256} 10:42:29.230945 --- ParallelTerminationStrategy: PID 27711 died... 10:42:29.249702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27711): Terminated: ok {rc=0} 10:42:29.294176 --- ParallelTerminationStrategy: PID 27712 died... 10:42:29.312907 run iperf3-srv_10.42.42.10(pid=27712): Terminated {rc=256} 10:42:29.356735 --- ParallelTerminationStrategy: PID 27713 died... 10:42:29.375460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27713): Terminated: ok {rc=0} 10:42:29.419448 --- ParallelTerminationStrategy: PID 27714 died... 10:42:29.438140 run iperf3-srv_10.42.42.10(pid=27714): Terminated {rc=256} 10:42:29.482164 --- ParallelTerminationStrategy: PID 27715 died... 10:42:29.500828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27715): Terminated: ok {rc=0} 10:42:29.544845 --- ParallelTerminationStrategy: PID 27716 died... 10:42:29.564372 run iperf3-srv_10.42.42.10(pid=27716): Terminated {rc=256} 10:42:29.608486 --- ParallelTerminationStrategy: PID 27719 died... 10:42:29.627326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27719): Terminated: ok {rc=0} 10:42:29.671422 --- ParallelTerminationStrategy: PID 27722 died... 10:42:29.690324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27722): Terminated: ok {rc=0} 10:42:29.734287 --- ParallelTerminationStrategy: PID 27725 died... 10:42:29.753098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27725): Terminated: ok {rc=0} 10:42:29.839691 bus /gobi_4: Setting Powered False 10:42:30.946816 bus /gobi_4: Setting Powered False 10:42:32.069444 bus /gobi_1: Setting Powered False 10:42:33.177866 bus /gobi_1: Setting Powered False 10:42:34.293179 bus /gobi_0: Setting Powered False 10:42:35.392910 bus /gobi_0: Setting Powered False 10:42:36.510655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:42:37.615114 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:37.626650 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:42:37.697186 tst ping.py: using LAC 20906 10:42:37.815598 tst ping.py: using RAC 251 10:42:37.933806 tst ping.py: using CellId 20906 10:42:38.050313 tst ping.py: using BVCI 20907 10:42:38.160051 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.170999 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.181805 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.192436 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.203039 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.213797 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.224465 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:38.235153 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:38.349036 tst ping.py:19: start network... 10:42:38.546853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:39.009089 run create_hlr_db(pid=27727): Launched 10:42:39.134724 bus /gobi_6: Setting Powered False 10:42:40.195148 run create_hlr_db(pid=27727): Terminated: ok {rc=0} 10:42:40.633704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Launched 10:42:40.958074 run osmo-hlr_10.42.42.2(pid=27730): Launched 10:42:41.082618 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:41.638632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Launched 10:42:41.959193 run osmo-stp_10.42.42.5(pid=27733): Launched 10:42:42.082255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:42.635116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27735): Launched 10:42:42.758279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:43.028814 run patchelf(pid=27736): Launched 10:42:43.210323 run osmo-stp_10.42.42.5(pid=27733): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] 10:42:43.346671 run osmo-stp_10.42.42.5(pid=27733): stdout: | (launched: 2022-12-09_10:42:41.900205) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:43.483343 run osmo-stp_10.42.42.5(pid=27733): stderr: | 20221209104242087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104242087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104242087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104242088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104242088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104242088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104242088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:43.620364 run osmo-stp_10.42.42.5(pid=27733): stdout: | (launched: 2022-12-09_10:42:41.900205) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:43.751197 run osmo-stp_10.42.42.5(pid=27733): stderr: | 20221209104242087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104242087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104242087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104242088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104242088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104242088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104242088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:43.906705 run patchelf(pid=27736): Terminating (SIGINT) 10:42:44.085641 run patchelf(pid=27736): Terminated: ok {rc=0} 10:42:44.214873 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27733): Process ended prematurely: osmo-stp_10.42.42.5(pid=27733) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 10:42:44.224546 tst ping.py:22: Test FAILED (6.6 sec) 10:42:44.253686 run osmo-hlr_10.42.42.2(pid=27730): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27730)] 10:42:44.304403 run osmo-hlr_10.42.42.2(pid=27730): stdout: | (launched: 2022-12-09_10:42:40.898708) 10:42:44.357428 run osmo-hlr_10.42.42.2(pid=27730): stderr: | 20221209104241093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104241093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104241093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104241093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104241093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104241093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104241104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104241112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104241112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104241113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:44.410603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Terminating (SIGTERM) 10:42:44.452795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Terminating (SIGTERM) 10:42:44.495166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27735): Terminating (SIGTERM) 10:42:44.538048 --- ParallelTerminationStrategy: PID 27729 died... 10:42:44.558243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Terminated: ok {rc=0} 10:42:44.605332 --- ParallelTerminationStrategy: PID 27732 died... 10:42:44.625137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Terminated: ok {rc=0} 10:42:44.671906 --- ParallelTerminationStrategy: PID 27735 died... 10:42:44.691548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27735): Terminated: ok {rc=0} 10:42:44.780193 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:42:45.888270 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:45.903359 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:42:45.995633 tst ping_idle_ping.py: using LAC 20907 10:42:46.118677 tst ping_idle_ping.py: using RAC 252 10:42:46.240515 tst ping_idle_ping.py: using CellId 20907 10:42:46.363757 tst ping_idle_ping.py: using BVCI 20908 10:42:46.513928 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.528865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.544093 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.558524 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.571426 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.586622 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.602288 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:42:46.617572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:42:46.764141 tst ping_idle_ping.py:24: start network... 10:42:47.029285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:47.534854 run create_hlr_db(pid=27737): Launched 10:42:47.660538 bus /gobi_6: Setting Powered False 10:42:48.724587 run create_hlr_db(pid=27737): Terminated: ok {rc=0} 10:42:49.155472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27739): Launched 10:42:49.456148 run osmo-hlr_10.42.42.2(pid=27740): Launched 10:42:49.572108 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:50.088056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27742): Launched 10:42:50.389154 run osmo-stp_10.42.42.5(pid=27743): Launched 10:42:50.503051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:51.018546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27745): Launched 10:42:51.133091 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:51.385408 run patchelf(pid=27746): Launched 10:42:51.551986 run osmo-stp_10.42.42.5(pid=27743): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27743)] 10:42:51.678867 run osmo-stp_10.42.42.5(pid=27743): stdout: | (launched: 2022-12-09_10:42:50.333253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:51.806450 run osmo-stp_10.42.42.5(pid=27743): stderr: | 20221209104250501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104250501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104250501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104250501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104250502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104250502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104250502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:51.959327 run osmo-stp_10.42.42.5(pid=27743): stdout: | (launched: 2022-12-09_10:42:50.333253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:52.081983 run osmo-stp_10.42.42.5(pid=27743): stderr: | 20221209104250501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104250501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104250501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104250501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104250502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104250502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104250502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:52.227198 run patchelf(pid=27746): Terminating (SIGINT) 10:42:52.394979 run patchelf(pid=27746): Terminated: ok {rc=0} 10:42:52.515490 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27743): Process ended prematurely: osmo-stp_10.42.42.5(pid=27743) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27743)] [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:42:52.524508 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:42:52.551632 run osmo-hlr_10.42.42.2(pid=27740): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27740)] 10:42:52.599359 run osmo-hlr_10.42.42.2(pid=27740): stdout: | (launched: 2022-12-09_10:42:49.400493) 10:42:52.649224 run osmo-hlr_10.42.42.2(pid=27740): stderr: | 20221209104249572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104249572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104249572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104249572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104249572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104249572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104249585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104249593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104249593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104249593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:52.699365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27739): Terminating (SIGTERM) 10:42:52.739318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27742): Terminating (SIGTERM) 10:42:52.779284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27745): Terminating (SIGTERM) 10:42:52.819545 --- ParallelTerminationStrategy: PID 27739 died... 10:42:52.838842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27739): Terminated: ok {rc=0} 10:42:52.883532 --- ParallelTerminationStrategy: PID 27742 died... 10:42:52.902347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27742): Terminated: ok {rc=0} 10:42:52.946568 --- ParallelTerminationStrategy: PID 27745 died... 10:42:52.965613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27745): Terminated: ok {rc=0} 10:42:53.050022 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:42:54.357414 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:54.365096 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:42:54.401597 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:42:54.437422 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:42:54.491877 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:42:54.526286 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:42:54.561949 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:42:55.117973 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:42:55.125319 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.136465 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:42:55.204537 tst switch_tch_pdch.py: using LAC 20908 10:42:55.322913 tst switch_tch_pdch.py: using RAC 253 10:42:55.441612 tst switch_tch_pdch.py: using CellId 20908 10:42:55.560742 tst switch_tch_pdch.py: using BVCI 20909 10:42:55.678804 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.690422 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.701835 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.713502 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.725087 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.737348 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.749133 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:42:55.760654 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:42:55.877710 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:42:56.003651 tst switch_tch_pdch.py:51: start network... 10:42:56.218587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:56.713750 run create_hlr_db(pid=27750): Launched 10:42:56.838451 bus /gobi_6: Setting Powered False 10:42:57.902145 run create_hlr_db(pid=27750): Terminated: ok {rc=0} 10:42:58.330491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27752): Launched 10:42:58.629315 run osmo-hlr_10.42.42.2(pid=27753): Launched 10:42:58.744180 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:59.262039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27755): Launched 10:42:59.560320 run osmo-stp_10.42.42.5(pid=27756): Launched 10:42:59.674815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:00.187890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27758): Launched 10:43:00.302221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:00.552820 run patchelf(pid=27759): Launched 10:43:00.719123 run osmo-stp_10.42.42.5(pid=27756): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27756)] 10:43:00.871094 run osmo-stp_10.42.42.5(pid=27756): stdout: | (launched: 2022-12-09_10:42:59.504155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:01.013666 run osmo-stp_10.42.42.5(pid=27756): stderr: | 20221209104259672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104259673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104259673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104259673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104259674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104259674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104259674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:01.159250 run osmo-stp_10.42.42.5(pid=27756): stdout: | (launched: 2022-12-09_10:42:59.504155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:01.294932 run osmo-stp_10.42.42.5(pid=27756): stderr: | 20221209104259672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104259673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104259673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104259673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104259674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104259674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104259674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:01.455390 run patchelf(pid=27759): Terminating (SIGINT) 10:43:01.639405 run patchelf(pid=27759): Terminated: ok {rc=0} 10:43:01.774789 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27756): Process ended prematurely: osmo-stp_10.42.42.5(pid=27756) [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27756)] [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:43:01.785580 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:43:01.818929 run osmo-hlr_10.42.42.2(pid=27753): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27753)] 10:43:01.873527 run osmo-hlr_10.42.42.2(pid=27753): stdout: | (launched: 2022-12-09_10:42:58.573823) 10:43:01.929121 run osmo-hlr_10.42.42.2(pid=27753): stderr: | 20221209104258747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104258747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104258747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104258747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104258747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104258747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104258759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104258770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104258770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104258770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:01.984640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27752): Terminating (SIGTERM) 10:43:02.029833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27755): Terminating (SIGTERM) 10:43:02.077567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27758): Terminating (SIGTERM) 10:43:02.124564 --- ParallelTerminationStrategy: PID 27752 died... 10:43:02.145189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27752): Terminated: ok {rc=0} 10:43:02.193693 --- ParallelTerminationStrategy: PID 27755 died... 10:43:02.213515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27755): Terminated: ok {rc=0} 10:43:02.261450 --- ParallelTerminationStrategy: PID 27758 died... 10:43:02.281111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27758): Terminated: ok {rc=0} 10:43:02.370362 bus /gobi_0: Setting Powered False 10:43:03.469803 bus /gobi_0: Setting Powered False 10:43:04.585695 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:43:05.832049 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:05.838154 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:43:05.870392 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:43:05.904186 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:43:05.957863 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:43:05.991182 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:43:06.024897 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:43:06.576677 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:43:06.581788 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:06.592503 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:43:06.661299 tst switch_tch_pdch.py: using LAC 20909 10:43:06.778749 tst switch_tch_pdch.py: using RAC 254 10:43:06.897430 tst switch_tch_pdch.py: using CellId 20909 10:43:07.023171 tst switch_tch_pdch.py: using BVCI 20910 10:43:07.139644 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.151209 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.162837 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.174455 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.185949 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.197585 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.209060 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:43:07.220502 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:43:07.337096 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:43:07.453842 tst switch_tch_pdch.py:51: start network... 10:43:07.652006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:08.088512 run create_hlr_db(pid=27763): Launched 10:43:08.211351 bus /gobi_6: Setting Powered False 10:43:09.270729 run create_hlr_db(pid=27763): Terminated: ok {rc=0} 10:43:09.661551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27765): Launched 10:43:09.959653 run osmo-hlr_10.42.42.2(pid=27766): Launched 10:43:10.072559 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:10.556629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27768): Launched 10:43:10.854053 run osmo-stp_10.42.42.5(pid=27769): Launched 10:43:10.966923 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:11.452660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27771): Launched 10:43:11.566061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:11.815723 run patchelf(pid=27772): Launched 10:43:11.981220 run osmo-stp_10.42.42.5(pid=27769): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27769)] 10:43:12.106200 run osmo-stp_10.42.42.5(pid=27769): stdout: | (launched: 2022-12-09_10:43:10.798891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:12.232637 run osmo-stp_10.42.42.5(pid=27769): stderr: | 20221209104310965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104310965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104310965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104310966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104310966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104310966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104310966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:12.359199 run osmo-stp_10.42.42.5(pid=27769): stdout: | (launched: 2022-12-09_10:43:10.798891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:12.480444 run osmo-stp_10.42.42.5(pid=27769): stderr: | 20221209104310965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104310965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104310965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104310966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104310966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104310966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104310966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:12.623974 run patchelf(pid=27772): Terminating (SIGINT) 10:43:12.790363 run patchelf(pid=27772): Terminated: ok {rc=0} 10:43:12.910319 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27769): Process ended prematurely: osmo-stp_10.42.42.5(pid=27769) [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27769)] [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:43:12.919165 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 10:43:12.945891 run osmo-hlr_10.42.42.2(pid=27766): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27766)] 10:43:12.993085 run osmo-hlr_10.42.42.2(pid=27766): stdout: | (launched: 2022-12-09_10:43:09.904375) 10:43:13.042014 run osmo-hlr_10.42.42.2(pid=27766): stderr: | 20221209104310075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104310075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104310075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104310075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104310075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104310075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104310091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104310100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104310101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104310101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:13.091546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27765): Terminating (SIGTERM) 10:43:13.130863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27768): Terminating (SIGTERM) 10:43:13.170190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27771): Terminating (SIGTERM) 10:43:13.209693 --- ParallelTerminationStrategy: PID 27765 died... 10:43:13.228593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27765): Terminated: ok {rc=0} 10:43:13.271988 --- ParallelTerminationStrategy: PID 27768 died... 10:43:13.290368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27768): Terminated: ok {rc=0} 10:43:13.333582 --- ParallelTerminationStrategy: PID 27771 died... 10:43:13.352149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27771): Terminated: ok {rc=0} 10:43:13.436817 bus /gobi_0: Setting Powered False 10:43:14.537601 bus /gobi_0: Setting Powered False 10:43:15.651470 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:43:16.919723 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:16.924081 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:43:16.957800 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:43:16.965923 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:43:17.021720 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:43:17.062672 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:43:17.071324 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:43:17.595794 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:43:17.600627 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:43:17.611375 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:43:17.654687 tst mo_mt_sms.py: using LAC 20910 10:43:17.785397 tst mo_mt_sms.py: using RAC 255 10:43:17.910353 tst mo_mt_sms.py: using CellId 20910 10:43:18.033199 tst mo_mt_sms.py: using BVCI 20911 10:43:18.149279 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:43:18.266253 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:43:18.382694 tst mo_mt_sms.py:9: start nitb and bts... 10:43:18.598121 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:43:19.247579 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27776): Launched 10:43:19.568662 run osmo-nitb_10.42.42.2(pid=27777): Launched 10:43:19.745980 run osmo-nitb_10.42.42.2(pid=27777): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27777)] 10:43:19.888577 run osmo-nitb_10.42.42.2(pid=27777): stdout: | (launched: 2022-12-09_10:43:19.510124) 10:43:20.032607 run osmo-nitb_10.42.42.2(pid=27777): stderr: | (launched: 2022-12-09_10:43:19.557456) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:43:20.176420 run osmo-nitb_10.42.42.2(pid=27777): stdout: | (launched: 2022-12-09_10:43:19.510124) 10:43:20.315275 run osmo-nitb_10.42.42.2(pid=27777): stderr: | (launched: 2022-12-09_10:43:19.557456) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27777): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27777) [trial-2358↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27777)] 10:43:20.689252 tst osmo-nitb_10.42.42.2(pid=27777): stdout: | (launched: 2022-12-09_10:43:19.510124) 10:43:20.817858 tst osmo-nitb_10.42.42.2(pid=27777): stderr: | (launched: 2022-12-09_10:43:19.557456) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:43:20.969466 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27777): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27777) [trial-2358↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27777)] [trial-2358↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 10:43:20.978663 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:43:20.985852 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27776): Terminating (SIGTERM) 10:43:21.198798 --- ParallelTerminationStrategy: PID 27776 died... 10:43:21.220474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27776): Terminated: ok {rc=0} 10:43:21.310729 bus /sierra_3: Setting Powered False 10:43:22.411636 bus /sierra_3: Setting Powered False 10:43:23.534563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:43:24.727980 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:24.732187 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:43:24.760642 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:43:24.787236 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:43:24.839643 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:43:24.868777 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:43:24.895012 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:43:25.444208 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:43:25.449842 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:25.461366 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:43:25.506820 tst mo_mt_sms.py: using LAC 20911 10:43:25.640710 tst mo_mt_sms.py: using RAC 1 10:43:25.765987 tst mo_mt_sms.py: using CellId 20911 10:43:25.892660 tst mo_mt_sms.py: using BVCI 20912 10:43:26.009878 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:26.020911 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:26.032105 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:26.043390 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:26.054547 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:26.065614 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:43:26.181423 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:43:26.300090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:26.795527 run create_hlr_db(pid=27781): Launched 10:43:26.919577 bus /sierra_2: Setting Powered False 10:43:27.982701 run create_hlr_db(pid=27781): Terminated: ok {rc=0} 10:43:28.428044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27783): Launched 10:43:28.747677 run osmo-hlr_10.42.42.2(pid=27784): Launched 10:43:28.871226 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:29.421728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27786): Launched 10:43:29.741309 run osmo-stp_10.42.42.5(pid=27787): Launched 10:43:29.864287 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:30.445071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27789): Launched 10:43:30.765269 run osmo-msc_10.42.42.6(pid=27790): Launched 10:43:31.016648 run osmo-stp_10.42.42.5(pid=27787): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27787)] 10:43:31.396871 run osmo-stp_10.42.42.5(pid=27787): stdout: | (launched: 2022-12-09_10:43:29.682537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:31.558503 run osmo-stp_10.42.42.5(pid=27787): stderr: | 20221209104329869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104329869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104329870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104329870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104329871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104329871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104329871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:31.696862 run osmo-stp_10.42.42.5(pid=27787): stdout: | (launched: 2022-12-09_10:43:29.682537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:31.829266 run osmo-stp_10.42.42.5(pid=27787): stderr: | 20221209104329869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104329869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104329870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104329870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104329871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104329871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104329871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:31.987343 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27787): Process ended prematurely: osmo-stp_10.42.42.5(pid=27787) [trial-2358↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27787)] [trial-2358↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 10:43:31.997502 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 10:43:32.029250 run osmo-hlr_10.42.42.2(pid=27784): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27784)] 10:43:32.082769 run osmo-hlr_10.42.42.2(pid=27784): stdout: | (launched: 2022-12-09_10:43:28.689070) 10:43:32.138226 run osmo-hlr_10.42.42.2(pid=27784): stderr: | 20221209104328884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104328884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104328884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104328884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104328884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104328884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104328897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104328905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104328905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104328905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:32.214674 run osmo-msc_10.42.42.6(pid=27790): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27790)] 10:43:32.268925 run osmo-msc_10.42.42.6(pid=27790): stdout: | (launched: 2022-12-09_10:43:30.706161) 10:43:32.322276 run osmo-msc_10.42.42.6(pid=27790): stderr: | 20221209104331191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104331191 DLGLOBAL DEBUG validating counter group 0x7f9a53f6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104331193 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104331193 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104331193 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104331193 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104331197 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104331199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104331199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104331200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:32.375984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27783): Terminating (SIGTERM) 10:43:32.418911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27786): Terminating (SIGTERM) 10:43:32.461872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27789): Terminating (SIGTERM) 10:43:32.505406 --- ParallelTerminationStrategy: PID 27783 died... 10:43:32.525726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27783): Terminated: ok {rc=0} 10:43:32.573899 --- ParallelTerminationStrategy: PID 27786 died... 10:43:32.594069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27786): Terminated: ok {rc=0} 10:43:32.641858 --- ParallelTerminationStrategy: PID 27789 died... 10:43:32.661976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27789): Terminated: ok {rc=0} 10:43:32.753059 bus /sierra_3: Setting Powered False 10:43:33.851907 bus /sierra_3: Setting Powered False 10:43:34.970303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:43:36.199693 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:36.203843 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:43:36.234502 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:43:36.241488 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:43:36.276768 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:43:36.306700 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:43:36.313629 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:43:36.834443 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:43:36.839558 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:43:36.850935 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:43:36.900581 tst assert_extension.py: using LAC 20912 10:43:37.025588 tst assert_extension.py: using RAC 2 10:43:37.143334 tst assert_extension.py: using CellId 20912 10:43:37.258638 tst assert_extension.py: using BVCI 20913 10:43:37.367553 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:43:37.485254 tst assert_extension.py:10: start nitb and bts... 10:43:37.699239 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:43:38.351608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27795): Launched 10:43:38.672875 run osmo-nitb_10.42.42.2(pid=27796): Launched 10:43:38.852081 run osmo-nitb_10.42.42.2(pid=27796): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27796)] 10:43:38.995464 run osmo-nitb_10.42.42.2(pid=27796): stdout: | (launched: 2022-12-09_10:43:38.614198) 10:43:39.140258 run osmo-nitb_10.42.42.2(pid=27796): stderr: | (launched: 2022-12-09_10:43:38.661636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:43:39.285158 run osmo-nitb_10.42.42.2(pid=27796): stdout: | (launched: 2022-12-09_10:43:38.614198) 10:43:39.425249 run osmo-nitb_10.42.42.2(pid=27796): stderr: | (launched: 2022-12-09_10:43:38.661636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27796): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27796) [trial-2358↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27796)] 10:43:39.794968 tst osmo-nitb_10.42.42.2(pid=27796): stdout: | (launched: 2022-12-09_10:43:38.614198) 10:43:39.923663 tst osmo-nitb_10.42.42.2(pid=27796): stderr: | (launched: 2022-12-09_10:43:38.661636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:43:40.075407 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27796): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27796) [trial-2358↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27796)] [trial-2358↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 10:43:40.084524 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:43:40.092028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27795): Terminating (SIGTERM) 10:43:40.304075 --- ParallelTerminationStrategy: PID 27795 died... 10:43:40.326061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27795): Terminated: ok {rc=0} 10:43:40.415860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:43:41.586478 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:41.590711 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:43:41.621111 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:43:41.648544 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:43:41.684289 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:43:41.714280 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:43:41.741645 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:43:42.268940 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:43:42.274261 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:42.285160 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:43:42.333234 tst assert_extension.py: using LAC 20913 10:43:42.450697 tst assert_extension.py: using RAC 3 10:43:42.567945 tst assert_extension.py: using CellId 20913 10:43:42.684604 tst assert_extension.py: using BVCI 20914 10:43:42.791639 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:42.802454 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:42.813068 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:42.823539 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:42.834141 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:42.844568 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:43:42.961657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:43.457552 run create_hlr_db(pid=27800): Launched 10:43:43.581963 bus /sierra_2: Setting Powered False 10:43:44.646365 run create_hlr_db(pid=27800): Terminated: ok {rc=0} 10:43:45.090564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27802): Launched 10:43:45.412028 run osmo-hlr_10.42.42.2(pid=27803): Launched 10:43:45.536410 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:46.102365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27805): Launched 10:43:46.443924 run osmo-stp_10.42.42.5(pid=27806): Launched 10:43:46.697753 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:47.280141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27808): Launched 10:43:47.611529 run osmo-msc_10.42.42.6(pid=27809): Launched 10:43:47.790730 run osmo-stp_10.42.42.5(pid=27806): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27806)] 10:43:47.925525 run osmo-stp_10.42.42.5(pid=27806): stdout: | (launched: 2022-12-09_10:43:46.380629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:48.060673 run osmo-stp_10.42.42.5(pid=27806): stderr: | 20221209104346567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104346567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104346567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104346568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104346568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104346568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104346569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:48.194097 run osmo-stp_10.42.42.5(pid=27806): stdout: | (launched: 2022-12-09_10:43:46.380629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:48.321070 run osmo-stp_10.42.42.5(pid=27806): stderr: | 20221209104346567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104346567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104346567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104346568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104346568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104346568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104346569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:48.473135 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27806): Process ended prematurely: osmo-stp_10.42.42.5(pid=27806) [trial-2358↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27806)] [trial-2358↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 10:43:48.482014 tst assert_extension.py:17: Test FAILED (6.2 sec) 10:43:48.509985 run osmo-hlr_10.42.42.2(pid=27803): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27803)] 10:43:48.560289 run osmo-hlr_10.42.42.2(pid=27803): stdout: | (launched: 2022-12-09_10:43:45.352470) 10:43:48.612373 run osmo-hlr_10.42.42.2(pid=27803): stderr: | 20221209104345548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104345548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104345548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104345548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104345548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104345548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104345561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104345569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104345569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104345569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:48.684627 run osmo-msc_10.42.42.6(pid=27809): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27809)] 10:43:48.734585 run osmo-msc_10.42.42.6(pid=27809): stdout: | (launched: 2022-12-09_10:43:47.552309) 10:43:48.786276 run osmo-msc_10.42.42.6(pid=27809): stderr: | 20221209104347872 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104347872 DLGLOBAL DEBUG validating counter group 0x7f987e324c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104347872 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104347872 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104347873 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104347873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104347875 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104347875 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104347875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104347875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:48.838444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27802): Terminating (SIGTERM) 10:43:48.880340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27805): Terminating (SIGTERM) 10:43:48.922321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27808): Terminating (SIGTERM) 10:43:48.964613 --- ParallelTerminationStrategy: PID 27802 died... 10:43:48.984606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27802): Terminated: ok {rc=0} 10:43:49.031043 --- ParallelTerminationStrategy: PID 27805 died... 10:43:49.050564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27805): Terminated: ok {rc=0} 10:43:49.096819 --- ParallelTerminationStrategy: PID 27808 died... 10:43:49.116685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27808): Terminated: ok {rc=0} 10:43:49.205560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:43:50.415881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:50.423171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:43:50.453894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:43:50.481383 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:43:50.535798 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:43:50.566011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:43:50.593901 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:43:51.141664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:43:51.192530 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:43:51.203898 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:43:51.270004 tst mo_mt_call.py: using LAC 20914 10:43:51.405200 tst mo_mt_call.py: using RAC 4 10:43:51.532686 tst mo_mt_call.py: using CellId 20914 10:43:51.658347 tst mo_mt_call.py: using BVCI 20915 10:43:51.777060 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:43:51.788869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:43:51.800669 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:43:51.813084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:43:51.824876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:43:51.837295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:43:51.951512 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:43:52.069609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:52.576462 run create_hlr_db(pid=27814): Launched 10:43:52.700940 bus /sierra_2: Setting Powered False 10:43:53.765842 run create_hlr_db(pid=27814): Terminated: ok {rc=0} 10:43:54.200585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Launched 10:43:54.505539 run osmo-hlr_10.42.42.2(pid=27818): Launched 10:43:54.622819 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:55.150076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Launched 10:43:55.457557 run osmo-stp_10.42.42.5(pid=27821): Launched 10:43:55.574935 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:56.128597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27823): Launched 10:43:56.432290 run osmo-msc_10.42.42.6(pid=27824): Launched 10:43:56.606665 run osmo-stp_10.42.42.5(pid=27821): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] 10:43:56.734321 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-09_10:43:55.401146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:56.861728 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221209104355567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104355568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104355568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104355568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104355569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104355569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104355569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:56.987218 run osmo-stp_10.42.42.5(pid=27821): stdout: | (launched: 2022-12-09_10:43:55.401146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:57.107534 run osmo-stp_10.42.42.5(pid=27821): stderr: | 20221209104355567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104355568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104355568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104355568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104355569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104355569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104355569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:57.251339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:43:57.260280 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:43:57.286874 run osmo-hlr_10.42.42.2(pid=27818): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27818)] 10:43:57.334342 run osmo-hlr_10.42.42.2(pid=27818): stdout: | (launched: 2022-12-09_10:43:54.449390) 10:43:57.383519 run osmo-hlr_10.42.42.2(pid=27818): stderr: | 20221209104354621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104354621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104354621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104354621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104354621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104354621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104354634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104354642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104354642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104354642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:57.452008 run osmo-msc_10.42.42.6(pid=27824): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27824)] 10:43:57.499246 run osmo-msc_10.42.42.6(pid=27824): stdout: | (launched: 2022-12-09_10:43:56.375964) 10:43:57.548054 run osmo-msc_10.42.42.6(pid=27824): stderr: | 20221209104356644 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104356645 DLGLOBAL DEBUG validating counter group 0x7f4d4383ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104356645 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104356645 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104356645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104356645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104356647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104356647 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104356647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104356647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:57.597659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminating (SIGTERM) 10:43:57.636822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminating (SIGTERM) 10:43:57.676196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27823): Terminating (SIGTERM) 10:43:57.716286 --- ParallelTerminationStrategy: PID 27817 died... 10:43:57.735588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27817): Terminated: ok {rc=0} 10:43:57.779231 --- ParallelTerminationStrategy: PID 27820 died... 10:43:57.797768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27820): Terminated: ok {rc=0} 10:43:57.841301 --- ParallelTerminationStrategy: PID 27823 died... 10:43:57.859872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27823): Terminated: ok {rc=0} 10:43:57.945230 bus /sierra_3: Setting Powered False 10:43:59.044319 bus /sierra_3: Setting Powered False 10:44:00.159699 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:44:01.312468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:44:01.325765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:44:01.397114 tst mo_mt_call_osmux.py: using LAC 20915 10:44:01.518764 tst mo_mt_call_osmux.py: using RAC 5 10:44:01.689222 tst mo_mt_call_osmux.py: using CellId 20915 10:44:01.815462 tst mo_mt_call_osmux.py: using BVCI 20916 10:44:01.931082 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:44:01.943438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:44:01.955479 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:44:01.967704 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:44:01.980153 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:44:01.992327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:44:02.115303 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:44:02.240417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:02.714211 run create_hlr_db(pid=27826): Launched 10:44:02.841948 bus /sierra_2: Setting Powered False 10:44:03.902950 run create_hlr_db(pid=27826): Terminated: ok {rc=0} 10:44:04.347569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27828): Launched 10:44:04.676028 run osmo-hlr_10.42.42.2(pid=27829): Launched 10:44:04.802141 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:05.367895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27831): Launched 10:44:05.694708 run osmo-stp_10.42.42.5(pid=27832): Launched 10:44:05.820387 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:06.413783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27834): Launched 10:44:06.739930 run osmo-msc_10.42.42.6(pid=27835): Launched 10:44:06.922139 run osmo-stp_10.42.42.5(pid=27832): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27832)] 10:44:07.058945 run osmo-stp_10.42.42.5(pid=27832): stdout: | (launched: 2022-12-09_10:44:05.635272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:07.196392 run osmo-stp_10.42.42.5(pid=27832): stderr: | 20221209104405825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104405825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104405825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104405826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104405826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104405826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104405826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:07.333582 run osmo-stp_10.42.42.5(pid=27832): stdout: | (launched: 2022-12-09_10:44:05.635272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:07.463706 run osmo-stp_10.42.42.5(pid=27832): stderr: | 20221209104405825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104405825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104405825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104405826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104405826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104405826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104405826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:07.619148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27832): Process ended prematurely: osmo-stp_10.42.42.5(pid=27832) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27832)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:44:07.628539 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:44:07.657332 run osmo-hlr_10.42.42.2(pid=27829): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27829)] 10:44:07.707956 run osmo-hlr_10.42.42.2(pid=27829): stdout: | (launched: 2022-12-09_10:44:04.616138) 10:44:07.760251 run osmo-hlr_10.42.42.2(pid=27829): stderr: | 20221209104404810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104404810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104404810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104404810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104404810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104404810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104404824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104404833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104404833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104404833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:07.833781 run osmo-msc_10.42.42.6(pid=27835): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27835)] 10:44:07.884312 run osmo-msc_10.42.42.6(pid=27835): stdout: | (launched: 2022-12-09_10:44:06.680243) 10:44:07.936392 run osmo-msc_10.42.42.6(pid=27835): stderr: | 20221209104406998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104406998 DLGLOBAL DEBUG validating counter group 0x7fa993ed6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104406999 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104406999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104406999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104406999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104407001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104407001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104407001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104407001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:07.989082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27828): Terminating (SIGTERM) 10:44:08.031149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27831): Terminating (SIGTERM) 10:44:08.073526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27834): Terminating (SIGTERM) 10:44:08.116110 --- ParallelTerminationStrategy: PID 27828 died... 10:44:08.136225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27828): Terminated: ok {rc=0} 10:44:08.182937 --- ParallelTerminationStrategy: PID 27831 died... 10:44:08.202541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27831): Terminated: ok {rc=0} 10:44:08.249250 --- ParallelTerminationStrategy: PID 27834 died... 10:44:08.268701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27834): Terminated: ok {rc=0} 10:44:08.358007 bus /sierra_3: Setting Powered False 10:44:09.455426 bus /sierra_3: Setting Powered False 10:44:10.570689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:44:11.826051 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:11.833303 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:44:11.864278 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:44:11.891687 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:44:11.943437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:44:11.973491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:44:12.000763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:44:12.555083 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:44:12.607881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:12.619536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:44:12.685290 tst mo_mt_call.py: using LAC 20916 10:44:12.811630 tst mo_mt_call.py: using RAC 6 10:44:12.930921 tst mo_mt_call.py: using CellId 20916 10:44:13.048458 tst mo_mt_call.py: using BVCI 20917 10:44:13.158773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:13.169908 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:13.181025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:13.192181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:13.203261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:13.214284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:44:13.333352 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:44:13.453600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:13.958904 run create_hlr_db(pid=27840): Launched 10:44:14.083922 bus /sierra_2: Setting Powered False 10:44:15.148909 run create_hlr_db(pid=27840): Terminated: ok {rc=0} 10:44:15.583916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27842): Launched 10:44:15.892919 run osmo-hlr_10.42.42.2(pid=27843): Launched 10:44:16.097500 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:16.787117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27845): Launched 10:44:17.132245 run osmo-stp_10.42.42.5(pid=27846): Launched 10:44:17.328004 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:17.916861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27848): Launched 10:44:18.220382 run osmo-msc_10.42.42.6(pid=27849): Launched 10:44:18.390154 run osmo-stp_10.42.42.5(pid=27846): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27846)] 10:44:18.517399 run osmo-stp_10.42.42.5(pid=27846): stdout: | (launched: 2022-12-09_10:44:17.071997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:18.644236 run osmo-stp_10.42.42.5(pid=27846): stderr: | 20221209104417350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104417351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104417351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104417351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104417352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104417352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104417352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:18.770304 run osmo-stp_10.42.42.5(pid=27846): stdout: | (launched: 2022-12-09_10:44:17.071997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:18.891466 run osmo-stp_10.42.42.5(pid=27846): stderr: | 20221209104417350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104417351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104417351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104417351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104417352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104417352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104417352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:19.035962 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27846): Process ended prematurely: osmo-stp_10.42.42.5(pid=27846) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27846)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:44:19.045185 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:44:19.072006 run osmo-hlr_10.42.42.2(pid=27843): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27843)] 10:44:19.119869 run osmo-hlr_10.42.42.2(pid=27843): stdout: | (launched: 2022-12-09_10:44:15.832112) 10:44:19.169294 run osmo-hlr_10.42.42.2(pid=27843): stderr: | 20221209104416116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104416116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104416116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104416116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104416116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104416116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104416143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104416171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104416171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104416172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:19.238070 run osmo-msc_10.42.42.6(pid=27849): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27849)] 10:44:19.285548 run osmo-msc_10.42.42.6(pid=27849): stdout: | (launched: 2022-12-09_10:44:18.164225) 10:44:19.334629 run osmo-msc_10.42.42.6(pid=27849): stderr: | 20221209104418435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104418435 DLGLOBAL DEBUG validating counter group 0x7f9cea78ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104418435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104418435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104418435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104418435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104418437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104418438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104418438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104418438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:19.384148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27842): Terminating (SIGTERM) 10:44:19.423559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27845): Terminating (SIGTERM) 10:44:19.463035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27848): Terminating (SIGTERM) 10:44:19.502858 --- ParallelTerminationStrategy: PID 27842 died... 10:44:19.522074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27842): Terminated: ok {rc=0} 10:44:19.566105 --- ParallelTerminationStrategy: PID 27845 died... 10:44:19.584719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27845): Terminated: ok {rc=0} 10:44:19.628653 --- ParallelTerminationStrategy: PID 27848 died... 10:44:19.647532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27848): Terminated: ok {rc=0} 10:44:19.733271 bus /sierra_3: Setting Powered False 10:44:20.832903 bus /sierra_3: Setting Powered False 10:44:21.948474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:44:23.100297 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:23.112772 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:44:23.180171 tst mo_mt_call_osmux.py: using LAC 20917 10:44:23.306377 tst mo_mt_call_osmux.py: using RAC 7 10:44:23.432924 tst mo_mt_call_osmux.py: using CellId 20917 10:44:23.559330 tst mo_mt_call_osmux.py: using BVCI 20918 10:44:23.679437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:23.691248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:23.702754 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:23.714595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:23.727057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:44:23.739258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:44:23.857954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:44:23.978135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:24.485516 run create_hlr_db(pid=27851): Launched 10:44:24.612056 bus /sierra_2: Setting Powered False 10:44:25.677266 run create_hlr_db(pid=27851): Terminated: ok {rc=0} 10:44:26.112689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27853): Launched 10:44:26.416387 run osmo-hlr_10.42.42.2(pid=27854): Launched 10:44:26.532702 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:27.055740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27856): Launched 10:44:27.361448 run osmo-stp_10.42.42.5(pid=27857): Launched 10:44:27.478296 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:28.033895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27859): Launched 10:44:28.339758 run osmo-msc_10.42.42.6(pid=27860): Launched 10:44:28.510316 run osmo-stp_10.42.42.5(pid=27857): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27857)] 10:44:28.639183 run osmo-stp_10.42.42.5(pid=27857): stdout: | (launched: 2022-12-09_10:44:27.304484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:28.766634 run osmo-stp_10.42.42.5(pid=27857): stderr: | 20221209104427473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104427473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104427473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104427474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104427474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104427474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104427474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:28.892915 run osmo-stp_10.42.42.5(pid=27857): stdout: | (launched: 2022-12-09_10:44:27.304484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:29.013815 run osmo-stp_10.42.42.5(pid=27857): stderr: | 20221209104427473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104427473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104427473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104427474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104427474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104427474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104427474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:29.159096 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27857): Process ended prematurely: osmo-stp_10.42.42.5(pid=27857) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27857)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:44:29.168035 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:44:29.194947 run osmo-hlr_10.42.42.2(pid=27854): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27854)] 10:44:29.242920 run osmo-hlr_10.42.42.2(pid=27854): stdout: | (launched: 2022-12-09_10:44:26.360166) 10:44:29.292489 run osmo-hlr_10.42.42.2(pid=27854): stderr: | 20221209104426534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104426534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104426534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104426534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104426534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104426534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104426550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104426560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104426561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104426561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:29.362222 run osmo-msc_10.42.42.6(pid=27860): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27860)] 10:44:29.410231 run osmo-msc_10.42.42.6(pid=27860): stdout: | (launched: 2022-12-09_10:44:28.283273) 10:44:29.459592 run osmo-msc_10.42.42.6(pid=27860): stderr: | 20221209104428554 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104428554 DLGLOBAL DEBUG validating counter group 0x7ff5fc22ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104428554 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104428554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104428554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104428555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104428556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104428557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104428557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104428557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:29.509691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27853): Terminating (SIGTERM) 10:44:29.549865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27856): Terminating (SIGTERM) 10:44:29.590563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27859): Terminating (SIGTERM) 10:44:29.631029 --- ParallelTerminationStrategy: PID 27853 died... 10:44:29.650383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27853): Terminated: ok {rc=0} 10:44:29.694804 --- ParallelTerminationStrategy: PID 27856 died... 10:44:29.713760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27856): Terminated: ok {rc=0} 10:44:29.757909 --- ParallelTerminationStrategy: PID 27859 died... 10:44:29.776784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27859): Terminated: ok {rc=0} 10:44:29.863562 bus /sierra_3: Setting Powered False 10:44:30.978456 bus /sierra_3: Setting Powered False 10:44:32.103860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:44:33.356069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:33.362854 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:44:33.391178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:44:33.417365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:44:33.470680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:44:33.499732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:44:33.526010 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:44:34.076562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:44:34.125308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:34.136491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:44:34.202171 tst mo_mt_call.py: using LAC 20918 10:44:34.320806 tst mo_mt_call.py: using RAC 8 10:44:34.441288 tst mo_mt_call.py: using CellId 20918 10:44:34.560121 tst mo_mt_call.py: using BVCI 20919 10:44:34.671474 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:34.682673 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:34.693647 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:34.704610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:34.715645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:34.728238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:44:34.848504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:44:34.965401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:35.437528 run create_hlr_db(pid=27865): Launched 10:44:35.563134 bus /sierra_2: Setting Powered False 10:44:36.623913 run create_hlr_db(pid=27865): Terminated: ok {rc=0} 10:44:37.070598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27867): Launched 10:44:37.399549 run osmo-hlr_10.42.42.2(pid=27868): Launched 10:44:37.527991 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:38.091232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27870): Launched 10:44:38.418363 run osmo-stp_10.42.42.5(pid=27871): Launched 10:44:38.542627 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:39.138457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27873): Launched 10:44:39.469170 run osmo-msc_10.42.42.6(pid=27874): Launched 10:44:39.654678 run osmo-stp_10.42.42.5(pid=27871): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27871)] 10:44:39.792493 run osmo-stp_10.42.42.5(pid=27871): stdout: | (launched: 2022-12-09_10:44:38.357933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:39.930706 run osmo-stp_10.42.42.5(pid=27871): stderr: | 20221209104438546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104438546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104438547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104438547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104438548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104438548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104438548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:40.067518 run osmo-stp_10.42.42.5(pid=27871): stdout: | (launched: 2022-12-09_10:44:38.357933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:40.198221 run osmo-stp_10.42.42.5(pid=27871): stderr: | 20221209104438546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104438546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104438547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104438547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104438548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104438548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104438548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:40.354289 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27871): Process ended prematurely: osmo-stp_10.42.42.5(pid=27871) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27871)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:44:40.363974 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:44:40.392885 run osmo-hlr_10.42.42.2(pid=27868): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27868)] 10:44:40.443620 run osmo-hlr_10.42.42.2(pid=27868): stdout: | (launched: 2022-12-09_10:44:37.338896) 10:44:40.495904 run osmo-hlr_10.42.42.2(pid=27868): stderr: | 20221209104437533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104437533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104437533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104437533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104437533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104437533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104437547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104437556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104437556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104437556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:40.568682 run osmo-msc_10.42.42.6(pid=27874): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27874)] 10:44:40.619439 run osmo-msc_10.42.42.6(pid=27874): stdout: | (launched: 2022-12-09_10:44:39.408241) 10:44:40.671523 run osmo-msc_10.42.42.6(pid=27874): stderr: | 20221209104439728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104439728 DLGLOBAL DEBUG validating counter group 0x7f36fac6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104439728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104439728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104439728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104439729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104439730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104439731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104439731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104439731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:40.723855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27867): Terminating (SIGTERM) 10:44:40.766128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27870): Terminating (SIGTERM) 10:44:40.808404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27873): Terminating (SIGTERM) 10:44:40.851352 --- ParallelTerminationStrategy: PID 27867 died... 10:44:40.871563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27867): Terminated: ok {rc=0} 10:44:40.918864 --- ParallelTerminationStrategy: PID 27870 died... 10:44:40.938563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27870): Terminated: ok {rc=0} 10:44:40.985317 --- ParallelTerminationStrategy: PID 27873 died... 10:44:41.004902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27873): Terminated: ok {rc=0} 10:44:41.093620 bus /sierra_3: Setting Powered False 10:44:42.191934 bus /sierra_3: Setting Powered False 10:44:43.307795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:44:44.458118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:44.470520 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:44:44.538890 tst mo_mt_call_osmux.py: using LAC 20919 10:44:44.667562 tst mo_mt_call_osmux.py: using RAC 9 10:44:44.788298 tst mo_mt_call_osmux.py: using CellId 20919 10:44:44.908146 tst mo_mt_call_osmux.py: using BVCI 20920 10:44:45.019870 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:45.031220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:45.042364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:45.053484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:45.064472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:44:45.075427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:44:45.193358 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:44:45.314530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:45.822210 run create_hlr_db(pid=27876): Launched 10:44:46.002013 bus /sierra_2: Setting Powered False 10:44:47.082535 run create_hlr_db(pid=27876): Terminated: ok {rc=0} 10:44:47.556173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27878): Launched 10:44:47.884693 run osmo-hlr_10.42.42.2(pid=27879): Launched 10:44:48.009522 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:48.577390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27881): Launched 10:44:48.905101 run osmo-stp_10.42.42.5(pid=27882): Launched 10:44:49.031063 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:49.621801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27884): Launched 10:44:49.950538 run osmo-msc_10.42.42.6(pid=27885): Launched 10:44:50.133538 run osmo-stp_10.42.42.5(pid=27882): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27882)] 10:44:50.270776 run osmo-stp_10.42.42.5(pid=27882): stdout: | (launched: 2022-12-09_10:44:48.845191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:50.409068 run osmo-stp_10.42.42.5(pid=27882): stderr: | 20221209104449034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104449034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104449034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104449035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104449035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104449035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104449035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:50.544568 run osmo-stp_10.42.42.5(pid=27882): stdout: | (launched: 2022-12-09_10:44:48.845191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:50.674620 run osmo-stp_10.42.42.5(pid=27882): stderr: | 20221209104449034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104449034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104449034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104449035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104449035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104449035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104449035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:50.830369 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27882): Process ended prematurely: osmo-stp_10.42.42.5(pid=27882) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27882)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:44:50.839831 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:44:50.868801 run osmo-hlr_10.42.42.2(pid=27879): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27879)] 10:44:50.919648 run osmo-hlr_10.42.42.2(pid=27879): stdout: | (launched: 2022-12-09_10:44:47.824886) 10:44:50.972343 run osmo-hlr_10.42.42.2(pid=27879): stderr: | 20221209104448019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104448019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104448019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104448019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104448019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104448019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104448032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104448041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104448041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104448041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:51.046148 run osmo-msc_10.42.42.6(pid=27885): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27885)] 10:44:51.097080 run osmo-msc_10.42.42.6(pid=27885): stdout: | (launched: 2022-12-09_10:44:49.889964) 10:44:51.149856 run osmo-msc_10.42.42.6(pid=27885): stderr: | 20221209104450208 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104450208 DLGLOBAL DEBUG validating counter group 0x7f93a91fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104450208 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104450208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104450209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104450209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104450210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104450211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104450211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104450211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:51.202918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27878): Terminating (SIGTERM) 10:44:51.245230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27881): Terminating (SIGTERM) 10:44:51.287533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27884): Terminating (SIGTERM) 10:44:51.330285 --- ParallelTerminationStrategy: PID 27878 died... 10:44:51.350452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27878): Terminated: ok {rc=0} 10:44:51.397560 --- ParallelTerminationStrategy: PID 27881 died... 10:44:51.417576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27881): Terminated: ok {rc=0} 10:44:51.464451 --- ParallelTerminationStrategy: PID 27884 died... 10:44:51.484262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27884): Terminated: ok {rc=0} 10:44:51.572763 bus /sierra_3: Setting Powered False 10:44:52.672604 bus /sierra_3: Setting Powered False 10:44:53.789222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:44:55.037531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:55.043969 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:44:55.074393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:44:55.101218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:44:55.152604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:44:55.181937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:44:55.208447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:44:55.759483 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:44:55.808373 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:44:55.819610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:44:55.885068 tst mo_mt_call.py: using LAC 20920 10:44:56.005292 tst mo_mt_call.py: using RAC 10 10:44:56.123779 tst mo_mt_call.py: using CellId 20920 10:44:56.251374 tst mo_mt_call.py: using BVCI 20921 10:44:56.362370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:44:56.373541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:44:56.384549 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:44:56.395581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:44:56.406637 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:44:56.417693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:44:56.534977 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:44:56.651201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:57.123044 run create_hlr_db(pid=27890): Launched 10:44:57.249378 bus /sierra_2: Setting Powered False 10:44:58.309997 run create_hlr_db(pid=27890): Terminated: ok {rc=0} 10:44:58.755166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27892): Launched 10:44:59.083298 run osmo-hlr_10.42.42.2(pid=27893): Launched 10:44:59.209405 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:59.776021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27895): Launched 10:45:00.102036 run osmo-stp_10.42.42.5(pid=27896): Launched 10:45:00.227659 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:00.817653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27898): Launched 10:45:01.171266 run osmo-msc_10.42.42.6(pid=27899): Launched 10:45:01.563942 run osmo-stp_10.42.42.5(pid=27896): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27896)] 10:45:01.829496 run osmo-stp_10.42.42.5(pid=27896): stdout: | (launched: 2022-12-09_10:45:00.042051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:01.979077 run osmo-stp_10.42.42.5(pid=27896): stderr: | 20221209104500231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104500232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104500232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104500232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104500233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104500233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104500233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:02.121360 run osmo-stp_10.42.42.5(pid=27896): stdout: | (launched: 2022-12-09_10:45:00.042051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:02.255195 run osmo-stp_10.42.42.5(pid=27896): stderr: | 20221209104500231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104500232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104500232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104500232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104500233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104500233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104500233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:02.415171 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27896): Process ended prematurely: osmo-stp_10.42.42.5(pid=27896) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27896)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:45:02.425369 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 10:45:02.454853 run osmo-hlr_10.42.42.2(pid=27893): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27893)] 10:45:02.506140 run osmo-hlr_10.42.42.2(pid=27893): stdout: | (launched: 2022-12-09_10:44:59.023609) 10:45:02.558956 run osmo-hlr_10.42.42.2(pid=27893): stderr: | 20221209104459215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104459215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104459215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104459215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104459216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104459216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104459228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104459238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104459239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104459239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:02.632667 run osmo-msc_10.42.42.6(pid=27899): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27899)] 10:45:02.683924 run osmo-msc_10.42.42.6(pid=27899): stdout: | (launched: 2022-12-09_10:45:01.108573) 10:45:02.736525 run osmo-msc_10.42.42.6(pid=27899): stderr: | 20221209104501543 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104501544 DLGLOBAL DEBUG validating counter group 0x7f112cac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104501544 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104501544 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104501544 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104501544 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104501546 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104501546 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104501547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104501547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:02.789651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27892): Terminating (SIGTERM) 10:45:02.832279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27895): Terminating (SIGTERM) 10:45:02.874926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27898): Terminating (SIGTERM) 10:45:02.917824 --- ParallelTerminationStrategy: PID 27892 died... 10:45:02.938055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27892): Terminated: ok {rc=0} 10:45:02.985945 --- ParallelTerminationStrategy: PID 27895 died... 10:45:03.005768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27895): Terminated: ok {rc=0} 10:45:03.053479 --- ParallelTerminationStrategy: PID 27898 died... 10:45:03.073384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27898): Terminated: ok {rc=0} 10:45:03.162890 bus /sierra_3: Setting Powered False 10:45:04.259525 bus /sierra_3: Setting Powered False 10:45:05.373790 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:45:06.520234 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:45:06.532279 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:45:06.597377 tst mo_mt_call_osmux.py: using LAC 20921 10:45:06.716335 tst mo_mt_call_osmux.py: using RAC 11 10:45:06.836918 tst mo_mt_call_osmux.py: using CellId 20921 10:45:06.970726 tst mo_mt_call_osmux.py: using BVCI 20922 10:45:07.091207 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:45:07.103149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:45:07.115273 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:45:07.127562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:45:07.139943 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:45:07.152121 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:45:07.269434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:45:07.388512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:07.896158 run create_hlr_db(pid=27904): Launched 10:45:08.020576 bus /sierra_2: Setting Powered False 10:45:09.085251 run create_hlr_db(pid=27904): Terminated: ok {rc=0} 10:45:09.539196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27906): Launched 10:45:09.867034 run osmo-hlr_10.42.42.2(pid=27907): Launched 10:45:09.993334 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:10.558539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27909): Launched 10:45:10.885150 run osmo-stp_10.42.42.5(pid=27910): Launched 10:45:11.011319 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:11.601643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27912): Launched 10:45:11.929040 run osmo-msc_10.42.42.6(pid=27913): Launched 10:45:12.111178 run osmo-stp_10.42.42.5(pid=27910): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27910)] 10:45:12.247875 run osmo-stp_10.42.42.5(pid=27910): stdout: | (launched: 2022-12-09_10:45:10.824825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:12.385488 run osmo-stp_10.42.42.5(pid=27910): stderr: | 20221209104511014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104511014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104511015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104511015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104511016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104511016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104511016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:12.521660 run osmo-stp_10.42.42.5(pid=27910): stdout: | (launched: 2022-12-09_10:45:10.824825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:12.651790 run osmo-stp_10.42.42.5(pid=27910): stderr: | 20221209104511014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104511014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104511015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104511015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104511016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104511016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104511016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:12.807867 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27910): Process ended prematurely: osmo-stp_10.42.42.5(pid=27910) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27910)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:45:12.817745 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:45:12.846735 run osmo-hlr_10.42.42.2(pid=27907): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27907)] 10:45:12.897264 run osmo-hlr_10.42.42.2(pid=27907): stdout: | (launched: 2022-12-09_10:45:09.807268) 10:45:12.949510 run osmo-hlr_10.42.42.2(pid=27907): stderr: | 20221209104510001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104510001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104510001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104510001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104510001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104510001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104510017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104510027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104510027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104510027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:13.021959 run osmo-msc_10.42.42.6(pid=27913): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27913)] 10:45:13.072447 run osmo-msc_10.42.42.6(pid=27913): stdout: | (launched: 2022-12-09_10:45:11.868659) 10:45:13.124265 run osmo-msc_10.42.42.6(pid=27913): stderr: | 20221209104512186 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104512187 DLGLOBAL DEBUG validating counter group 0x7f2a2cdd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104512187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104512187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104512187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104512187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104512189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104512189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104512189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104512190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:13.176842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27906): Terminating (SIGTERM) 10:45:13.219315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27909): Terminating (SIGTERM) 10:45:13.261702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27912): Terminating (SIGTERM) 10:45:13.304444 --- ParallelTerminationStrategy: PID 27906 died... 10:45:13.324784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27906): Terminated: ok {rc=0} 10:45:13.371699 --- ParallelTerminationStrategy: PID 27909 died... 10:45:13.391473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27909): Terminated: ok {rc=0} 10:45:13.438467 --- ParallelTerminationStrategy: PID 27912 died... 10:45:13.458300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27912): Terminated: ok {rc=0} 10:45:13.547083 bus /sierra_3: Setting Powered False 10:45:14.645861 bus /sierra_3: Setting Powered False 10:45:15.760763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:45:17.020192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:17.031238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:45:17.072688 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:45:17.109077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:45:17.167524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:45:17.205311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:45:17.233448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:45:17.787994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:45:17.839637 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:17.850789 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:45:17.916446 tst mo_mt_call.py: using LAC 20922 10:45:18.036836 tst mo_mt_call.py: using RAC 12 10:45:18.162197 tst mo_mt_call.py: using CellId 20922 10:45:18.281637 tst mo_mt_call.py: using BVCI 20923 10:45:18.392629 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:18.403842 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:18.414844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:18.426737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:18.438367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:18.449882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:45:18.566828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:45:18.680691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:19.152238 run create_hlr_db(pid=27918): Launched 10:45:19.277072 bus /sierra_2: Setting Powered False 10:45:20.337917 run create_hlr_db(pid=27918): Terminated: ok {rc=0} 10:45:20.782532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27920): Launched 10:45:21.109283 run osmo-hlr_10.42.42.2(pid=27921): Launched 10:45:21.235857 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:21.799626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27923): Launched 10:45:22.126728 run osmo-stp_10.42.42.5(pid=27924): Launched 10:45:22.252830 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:22.844020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27926): Launched 10:45:23.173646 run osmo-msc_10.42.42.6(pid=27927): Launched 10:45:23.359481 run osmo-stp_10.42.42.5(pid=27924): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27924)] 10:45:23.498331 run osmo-stp_10.42.42.5(pid=27924): stdout: | (launched: 2022-12-09_10:45:22.067045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:23.639248 run osmo-stp_10.42.42.5(pid=27924): stderr: | 20221209104522256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104522256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104522257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104522257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104522258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104522258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104522258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:23.776318 run osmo-stp_10.42.42.5(pid=27924): stdout: | (launched: 2022-12-09_10:45:22.067045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:23.907098 run osmo-stp_10.42.42.5(pid=27924): stderr: | 20221209104522256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104522256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104522257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104522257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104522258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104522258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104522258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:24.062937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27924): Process ended prematurely: osmo-stp_10.42.42.5(pid=27924) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27924)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:45:24.072852 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:45:24.102158 run osmo-hlr_10.42.42.2(pid=27921): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27921)] 10:45:24.152554 run osmo-hlr_10.42.42.2(pid=27921): stdout: | (launched: 2022-12-09_10:45:21.049439) 10:45:24.204785 run osmo-hlr_10.42.42.2(pid=27921): stderr: | 20221209104521246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104521246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104521246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104521246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104521246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104521246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104521259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104521269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104521270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104521270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:24.277547 run osmo-msc_10.42.42.6(pid=27927): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27927)] 10:45:24.327835 run osmo-msc_10.42.42.6(pid=27927): stdout: | (launched: 2022-12-09_10:45:23.113404) 10:45:24.379981 run osmo-msc_10.42.42.6(pid=27927): stderr: | 20221209104523434 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104523434 DLGLOBAL DEBUG validating counter group 0x7f17220c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104523434 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104523434 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104523434 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104523434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104523436 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104523436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104523437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104523437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:24.432897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27920): Terminating (SIGTERM) 10:45:24.475294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27923): Terminating (SIGTERM) 10:45:24.517774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27926): Terminating (SIGTERM) 10:45:24.560547 --- ParallelTerminationStrategy: PID 27920 died... 10:45:24.580659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27920): Terminated: ok {rc=0} 10:45:24.627708 --- ParallelTerminationStrategy: PID 27923 died... 10:45:24.647435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27923): Terminated: ok {rc=0} 10:45:24.694363 --- ParallelTerminationStrategy: PID 27926 died... 10:45:24.714087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27926): Terminated: ok {rc=0} 10:45:24.802320 bus /sierra_3: Setting Powered False 10:45:25.901179 bus /sierra_3: Setting Powered False 10:45:27.018580 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:45:28.161763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:28.173557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:45:28.238546 tst mo_mt_call_osmux.py: using LAC 20923 10:45:28.359421 tst mo_mt_call_osmux.py: using RAC 13 10:45:28.478900 tst mo_mt_call_osmux.py: using CellId 20923 10:45:28.607739 tst mo_mt_call_osmux.py: using BVCI 20924 10:45:28.726438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:28.738369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:28.750244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:28.762488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:28.774657 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:45:28.786822 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:45:28.906553 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:45:29.025943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:29.533242 run create_hlr_db(pid=27929): Launched 10:45:29.658825 bus /sierra_2: Setting Powered False 10:45:30.723660 run create_hlr_db(pid=27929): Terminated: ok {rc=0} 10:45:31.193044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27931): Launched 10:45:31.525781 run osmo-hlr_10.42.42.2(pid=27932): Launched 10:45:31.758973 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:32.391953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27934): Launched 10:45:32.720526 run osmo-stp_10.42.42.5(pid=27935): Launched 10:45:32.847118 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:33.437241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27937): Launched 10:45:33.765221 run osmo-msc_10.42.42.6(pid=27938): Launched 10:45:33.949304 run osmo-stp_10.42.42.5(pid=27935): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27935)] 10:45:34.086789 run osmo-stp_10.42.42.5(pid=27935): stdout: | (launched: 2022-12-09_10:45:32.660577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:34.224413 run osmo-stp_10.42.42.5(pid=27935): stderr: | 20221209104532851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104532851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104532852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104532852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104532853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104532853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104532853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:34.354864 run osmo-stp_10.42.42.5(pid=27935): stdout: | (launched: 2022-12-09_10:45:32.660577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:34.476931 run osmo-stp_10.42.42.5(pid=27935): stderr: | 20221209104532851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104532851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104532852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104532852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104532853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104532853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104532853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:34.623010 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27935): Process ended prematurely: osmo-stp_10.42.42.5(pid=27935) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27935)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:45:34.632172 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:45:34.659989 run osmo-hlr_10.42.42.2(pid=27932): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27932)] 10:45:34.709008 run osmo-hlr_10.42.42.2(pid=27932): stdout: | (launched: 2022-12-09_10:45:31.463242) 10:45:34.759484 run osmo-hlr_10.42.42.2(pid=27932): stderr: | 20221209104531654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104531654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104531654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104531654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104531654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104531654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104531674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104531682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104531682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104531682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:34.829812 run osmo-msc_10.42.42.6(pid=27938): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27938)] 10:45:34.878366 run osmo-msc_10.42.42.6(pid=27938): stdout: | (launched: 2022-12-09_10:45:33.705165) 10:45:34.928679 run osmo-msc_10.42.42.6(pid=27938): stderr: | 20221209104534029 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104534029 DLGLOBAL DEBUG validating counter group 0x7f77e3e30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104534029 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104534029 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104534029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104534030 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104534031 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104534032 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104534032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104534032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:34.979232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27931): Terminating (SIGTERM) 10:45:35.019351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27934): Terminating (SIGTERM) 10:45:35.059970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27937): Terminating (SIGTERM) 10:45:35.101058 --- ParallelTerminationStrategy: PID 27931 died... 10:45:35.120227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27931): Terminated: ok {rc=0} 10:45:35.165699 --- ParallelTerminationStrategy: PID 27934 died... 10:45:35.184577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27934): Terminated: ok {rc=0} 10:45:35.229747 --- ParallelTerminationStrategy: PID 27937 died... 10:45:35.248391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27937): Terminated: ok {rc=0} 10:45:35.335005 bus /sierra_3: Setting Powered False 10:45:36.434495 bus /sierra_3: Setting Powered False 10:45:37.549719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:45:38.792734 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:38.799533 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:45:38.828275 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:45:38.854427 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:45:38.908080 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:45:38.938617 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:45:38.965897 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:45:39.516102 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:45:39.566174 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:39.577578 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:45:39.642902 tst mo_mt_call.py: using LAC 20924 10:45:39.761487 tst mo_mt_call.py: using RAC 14 10:45:39.884255 tst mo_mt_call.py: using CellId 20924 10:45:40.026578 tst mo_mt_call.py: using BVCI 20925 10:45:40.147051 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:40.159135 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:40.170858 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:40.183291 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:40.195474 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:40.207637 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:45:40.324034 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:45:40.444213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:40.952094 run create_hlr_db(pid=27943): Launched 10:45:41.076162 bus /sierra_2: Setting Powered False 10:45:42.139986 run create_hlr_db(pid=27943): Terminated: ok {rc=0} 10:45:42.575029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27945): Launched 10:45:42.882134 run osmo-hlr_10.42.42.2(pid=27946): Launched 10:45:42.998075 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:43.522039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27948): Launched 10:45:43.828911 run osmo-stp_10.42.42.5(pid=27949): Launched 10:45:43.944451 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:44.495375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27951): Launched 10:45:44.802676 run osmo-msc_10.42.42.6(pid=27952): Launched 10:45:44.974229 run osmo-stp_10.42.42.5(pid=27949): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27949)] 10:45:45.101978 run osmo-stp_10.42.42.5(pid=27949): stdout: | (launched: 2022-12-09_10:45:43.772326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:45.229442 run osmo-stp_10.42.42.5(pid=27949): stderr: | 20221209104543940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104543940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104543941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104543941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104543942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104543942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104543942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:45.355349 run osmo-stp_10.42.42.5(pid=27949): stdout: | (launched: 2022-12-09_10:45:43.772326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:45.475686 run osmo-stp_10.42.42.5(pid=27949): stderr: | 20221209104543940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104543940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104543941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104543941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104543942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104543942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104543942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:45.620076 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27949): Process ended prematurely: osmo-stp_10.42.42.5(pid=27949) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27949)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:45:45.629017 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:45:45.655662 run osmo-hlr_10.42.42.2(pid=27946): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27946)] 10:45:45.703181 run osmo-hlr_10.42.42.2(pid=27946): stdout: | (launched: 2022-12-09_10:45:42.825195) 10:45:45.752277 run osmo-hlr_10.42.42.2(pid=27946): stderr: | 20221209104542999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104542999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104542999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104542999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104542999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104542999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104543012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104543022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104543022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104543023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:45.821059 run osmo-msc_10.42.42.6(pid=27952): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27952)] 10:45:45.874423 run osmo-msc_10.42.42.6(pid=27952): stdout: | (launched: 2022-12-09_10:45:44.744845) 10:45:45.937699 run osmo-msc_10.42.42.6(pid=27952): stderr: | 20221209104545017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104545017 DLGLOBAL DEBUG validating counter group 0x7f5aea1ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104545017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104545017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104545018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104545018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104545019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104545020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104545020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104545020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:45.988174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27945): Terminating (SIGTERM) 10:45:46.028288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27948): Terminating (SIGTERM) 10:45:46.074588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27951): Terminating (SIGTERM) 10:45:46.121595 --- ParallelTerminationStrategy: PID 27945 died... 10:45:46.142779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27945): Terminated: ok {rc=0} 10:45:46.187489 --- ParallelTerminationStrategy: PID 27948 died... 10:45:46.206479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27948): Terminated: ok {rc=0} 10:45:46.251206 --- ParallelTerminationStrategy: PID 27951 died... 10:45:46.270465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27951): Terminated: ok {rc=0} 10:45:46.355071 bus /sierra_3: Setting Powered False 10:45:47.450303 bus /sierra_3: Setting Powered False 10:45:48.564560 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:45:49.710917 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:49.722806 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:45:49.787802 tst mo_mt_call_osmux.py: using LAC 20925 10:45:49.905941 tst mo_mt_call_osmux.py: using RAC 15 10:45:50.023336 tst mo_mt_call_osmux.py: using CellId 20925 10:45:50.142403 tst mo_mt_call_osmux.py: using BVCI 20926 10:45:50.253823 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:50.265272 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:50.276381 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:50.287582 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:50.298817 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:45:50.309928 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:45:50.429393 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:45:50.548190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:51.057181 run create_hlr_db(pid=27954): Launched 10:45:51.181943 bus /sierra_2: Setting Powered False 10:45:52.246685 run create_hlr_db(pid=27954): Terminated: ok {rc=0} 10:45:52.682845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27956): Launched 10:45:52.986385 run osmo-hlr_10.42.42.2(pid=27957): Launched 10:45:53.102603 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:53.625405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27959): Launched 10:45:53.930216 run osmo-stp_10.42.42.5(pid=27960): Launched 10:45:54.046596 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:54.596194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27962): Launched 10:45:54.903169 run osmo-msc_10.42.42.6(pid=27963): Launched 10:45:55.074231 run osmo-stp_10.42.42.5(pid=27960): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27960)] 10:45:55.202414 run osmo-stp_10.42.42.5(pid=27960): stdout: | (launched: 2022-12-09_10:45:53.873740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:55.330291 run osmo-stp_10.42.42.5(pid=27960): stderr: | 20221209104554041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104554042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104554042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104554042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104554043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104554043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104554043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:55.456168 run osmo-stp_10.42.42.5(pid=27960): stdout: | (launched: 2022-12-09_10:45:53.873740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:55.576661 run osmo-stp_10.42.42.5(pid=27960): stderr: | 20221209104554041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104554042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104554042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104554042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104554043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104554043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104554043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:55.721250 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27960): Process ended prematurely: osmo-stp_10.42.42.5(pid=27960) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27960)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:45:55.730243 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:45:55.756894 run osmo-hlr_10.42.42.2(pid=27957): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27957)] 10:45:55.804898 run osmo-hlr_10.42.42.2(pid=27957): stdout: | (launched: 2022-12-09_10:45:52.930016) 10:45:55.854505 run osmo-hlr_10.42.42.2(pid=27957): stderr: | 20221209104553105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104553105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104553105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104553105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104553105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104553105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104553118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104553126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104553127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104553127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:55.923794 run osmo-msc_10.42.42.6(pid=27963): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27963)] 10:45:55.971400 run osmo-msc_10.42.42.6(pid=27963): stdout: | (launched: 2022-12-09_10:45:54.846632) 10:45:56.020852 run osmo-msc_10.42.42.6(pid=27963): stderr: | 20221209104555117 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104555117 DLGLOBAL DEBUG validating counter group 0x7f8e700c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104555118 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104555118 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104555118 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104555118 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104555120 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104555120 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104555120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104555120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:56.070571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27956): Terminating (SIGTERM) 10:45:56.110419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27959): Terminating (SIGTERM) 10:45:56.150095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27962): Terminating (SIGTERM) 10:45:56.190318 --- ParallelTerminationStrategy: PID 27956 died... 10:45:56.209265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27956): Terminated: ok {rc=0} 10:45:56.253397 --- ParallelTerminationStrategy: PID 27959 died... 10:45:56.271962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27959): Terminated: ok {rc=0} 10:45:56.316121 --- ParallelTerminationStrategy: PID 27962 died... 10:45:56.334865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27962): Terminated: ok {rc=0} 10:45:56.422904 bus /sierra_3: Setting Powered False 10:45:57.521665 bus /sierra_3: Setting Powered False 10:45:58.635578 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:45:59.890138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:59.896503 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:45:59.927145 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:45:59.954237 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:46:00.008399 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:46:00.037262 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:46:00.063206 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:46:00.617851 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:46:00.672764 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:00.684677 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:46:00.750734 tst mo_mt_call.py: using LAC 20926 10:46:00.885372 tst mo_mt_call.py: using RAC 16 10:46:01.023427 tst mo_mt_call.py: using CellId 20926 10:46:01.151944 tst mo_mt_call.py: using BVCI 20927 10:46:01.265971 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:01.278902 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:01.290447 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:01.302054 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:01.314288 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:01.326270 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:46:01.443970 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:46:01.563484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:02.057150 run create_hlr_db(pid=27968): Launched 10:46:02.217288 bus /sierra_2: Setting Powered False 10:46:03.278135 run create_hlr_db(pid=27968): Terminated: ok {rc=0} 10:46:03.703527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27970): Launched 10:46:04.007897 run osmo-hlr_10.42.42.2(pid=27971): Launched 10:46:04.123634 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:04.652238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27973): Launched 10:46:04.958652 run osmo-stp_10.42.42.5(pid=27974): Launched 10:46:05.076829 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:05.627646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27976): Launched 10:46:05.933396 run osmo-msc_10.42.42.6(pid=27977): Launched 10:46:06.105841 run osmo-stp_10.42.42.5(pid=27974): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27974)] 10:46:06.235032 run osmo-stp_10.42.42.5(pid=27974): stdout: | (launched: 2022-12-09_10:46:04.902222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:06.364348 run osmo-stp_10.42.42.5(pid=27974): stderr: | 20221209104605069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104605069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104605069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104605070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104605070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104605070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104605070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:06.492134 run osmo-stp_10.42.42.5(pid=27974): stdout: | (launched: 2022-12-09_10:46:04.902222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:06.614414 run osmo-stp_10.42.42.5(pid=27974): stderr: | 20221209104605069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104605069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104605069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104605070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104605070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104605070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104605070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:06.761853 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27974): Process ended prematurely: osmo-stp_10.42.42.5(pid=27974) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27974)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:46:06.770975 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:46:06.797912 run osmo-hlr_10.42.42.2(pid=27971): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27971)] 10:46:06.846337 run osmo-hlr_10.42.42.2(pid=27971): stdout: | (launched: 2022-12-09_10:46:03.951388) 10:46:06.895803 run osmo-hlr_10.42.42.2(pid=27971): stderr: | 20221209104604127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104604127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104604127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104604127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104604127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104604127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104604140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104604149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104604150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104604150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:06.964852 run osmo-msc_10.42.42.6(pid=27977): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27977)] 10:46:07.012860 run osmo-msc_10.42.42.6(pid=27977): stdout: | (launched: 2022-12-09_10:46:05.876491) 10:46:07.062050 run osmo-msc_10.42.42.6(pid=27977): stderr: | 20221209104606148 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104606148 DLGLOBAL DEBUG validating counter group 0x7fa1472fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104606148 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104606148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104606149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104606149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104606150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104606151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104606151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104606151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:07.111802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27970): Terminating (SIGTERM) 10:46:07.151461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27973): Terminating (SIGTERM) 10:46:07.191211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27976): Terminating (SIGTERM) 10:46:07.231280 --- ParallelTerminationStrategy: PID 27970 died... 10:46:07.250836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27970): Terminated: ok {rc=0} 10:46:07.294619 --- ParallelTerminationStrategy: PID 27973 died... 10:46:07.313257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27973): Terminated: ok {rc=0} 10:46:07.356742 --- ParallelTerminationStrategy: PID 27976 died... 10:46:07.375260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27976): Terminated: ok {rc=0} 10:46:07.457825 bus /sierra_3: Setting Powered False 10:46:08.554815 bus /sierra_3: Setting Powered False 10:46:09.666476 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:46:10.815471 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:10.828175 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:46:10.897277 tst mo_mt_call_osmux.py: using LAC 20927 10:46:11.025575 tst mo_mt_call_osmux.py: using RAC 17 10:46:11.155355 tst mo_mt_call_osmux.py: using CellId 20927 10:46:11.282688 tst mo_mt_call_osmux.py: using BVCI 20928 10:46:11.401465 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:11.413210 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:11.424422 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:11.436119 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:11.448018 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:46:11.459607 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:46:11.576763 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:46:11.692859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:12.201345 run create_hlr_db(pid=27979): Launched 10:46:12.326313 bus /sierra_2: Setting Powered False 10:46:13.392055 run create_hlr_db(pid=27979): Terminated: ok {rc=0} 10:46:13.828719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27981): Launched 10:46:14.135201 run osmo-hlr_10.42.42.2(pid=27982): Launched 10:46:14.251381 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:14.791867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27984): Launched 10:46:15.097506 run osmo-stp_10.42.42.5(pid=27985): Launched 10:46:15.214382 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:15.767384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27987): Launched 10:46:16.121727 run osmo-msc_10.42.42.6(pid=27988): Launched 10:46:16.529871 run osmo-stp_10.42.42.5(pid=27985): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27985)] 10:46:16.758763 run osmo-stp_10.42.42.5(pid=27985): stdout: | (launched: 2022-12-09_10:46:15.040874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:16.918243 run osmo-stp_10.42.42.5(pid=27985): stderr: | 20221209104615210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104615211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104615211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104615211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104615212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104615212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104615212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:17.058410 run osmo-stp_10.42.42.5(pid=27985): stdout: | (launched: 2022-12-09_10:46:15.040874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:17.193629 run osmo-stp_10.42.42.5(pid=27985): stderr: | 20221209104615210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104615211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104615211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104615211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104615212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104615212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104615212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:17.354620 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27985): Process ended prematurely: osmo-stp_10.42.42.5(pid=27985) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27985)] [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:46:17.365302 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:46:17.395258 run osmo-hlr_10.42.42.2(pid=27982): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27982)] 10:46:17.446648 run osmo-hlr_10.42.42.2(pid=27982): stdout: | (launched: 2022-12-09_10:46:14.078242) 10:46:17.499602 run osmo-hlr_10.42.42.2(pid=27982): stderr: | 20221209104614251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104614251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104614251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104614251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104614251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104614252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104614264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104614273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104614273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104614274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:17.572798 run osmo-msc_10.42.42.6(pid=27988): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27988)] 10:46:17.623337 run osmo-msc_10.42.42.6(pid=27988): stdout: | (launched: 2022-12-09_10:46:16.056509) 10:46:17.675554 run osmo-msc_10.42.42.6(pid=27988): stderr: | 20221209104616434 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104616434 DLGLOBAL DEBUG validating counter group 0x7f321d6b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104616434 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104616434 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104616434 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104616434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104616445 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104616446 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104616446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104616446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:17.728039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27981): Terminating (SIGTERM) 10:46:17.770399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27984): Terminating (SIGTERM) 10:46:17.812671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27987): Terminating (SIGTERM) 10:46:17.855838 --- ParallelTerminationStrategy: PID 27981 died... 10:46:17.876039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27981): Terminated: ok {rc=0} 10:46:17.922957 --- ParallelTerminationStrategy: PID 27984 died... 10:46:17.942651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27984): Terminated: ok {rc=0} 10:46:17.989455 --- ParallelTerminationStrategy: PID 27987 died... 10:46:18.009133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27987): Terminated: ok {rc=0} 10:46:18.097832 bus /sierra_3: Setting Powered False 10:46:19.197452 bus /sierra_3: Setting Powered False 10:46:20.313495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 10:46:21.556087 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:21.560722 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:46:21.589415 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:46:21.615529 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 10:46:21.698748 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:46:21.727422 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:46:21.753587 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 10:46:22.336566 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 10:46:22.341645 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:22.352357 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:46:22.397374 tst emergency_mo_mt_call.py: using LAC 20928 10:46:22.514818 tst emergency_mo_mt_call.py: using RAC 18 10:46:22.634331 tst emergency_mo_mt_call.py: using CellId 20928 10:46:22.753073 tst emergency_mo_mt_call.py: using BVCI 20929 10:46:22.861550 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:22.872469 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:22.883493 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:22.894092 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:22.904642 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:22.915553 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:23.028299 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:23.146454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:23.644114 run create_hlr_db(pid=27993): Launched 10:46:23.768032 bus /sierra_2: Setting Powered False 10:46:24.831943 run create_hlr_db(pid=27993): Terminated: ok {rc=0} 10:46:25.261773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27995): Launched 10:46:25.561270 run osmo-hlr_10.42.42.2(pid=27996): Launched 10:46:25.676566 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:26.231018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27998): Launched 10:46:26.553561 run osmo-stp_10.42.42.5(pid=27999): Launched 10:46:26.685353 tst emergency_mo_mt_call.py: using MSISDN 7164 10:46:26.850343 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:27.431976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28001): Launched 10:46:27.755271 run osmo-msc_10.42.42.6(pid=28002): Launched 10:46:27.935177 run osmo-stp_10.42.42.5(pid=27999): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27999)] 10:46:28.070977 run osmo-stp_10.42.42.5(pid=27999): stdout: | (launched: 2022-12-09_10:46:26.494138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:28.206716 run osmo-stp_10.42.42.5(pid=27999): stderr: | 20221209104626686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104626686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104626687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104626687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104626688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104626688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104626688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:28.341543 run osmo-stp_10.42.42.5(pid=27999): stdout: | (launched: 2022-12-09_10:46:26.494138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:28.469290 run osmo-stp_10.42.42.5(pid=27999): stderr: | 20221209104626686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104626686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104626687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104626687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104626688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104626688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104626688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:28.621486 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27999): Process ended prematurely: osmo-stp_10.42.42.5(pid=27999) [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27999)] [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 10:46:28.630494 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 10:46:28.658617 run osmo-hlr_10.42.42.2(pid=27996): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27996)] 10:46:28.709586 run osmo-hlr_10.42.42.2(pid=27996): stdout: | (launched: 2022-12-09_10:46:25.505670) 10:46:28.761593 run osmo-hlr_10.42.42.2(pid=27996): stderr: | 20221209104625680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104625680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104625680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104625680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104625680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104625681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104625691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104625699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104625700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104625700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:28.833835 run osmo-msc_10.42.42.6(pid=28002): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28002)] 10:46:28.883996 run osmo-msc_10.42.42.6(pid=28002): stdout: | (launched: 2022-12-09_10:46:27.695937) 10:46:28.936122 run osmo-msc_10.42.42.6(pid=28002): stderr: | 20221209104628015 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104628015 DLGLOBAL DEBUG validating counter group 0x7f8d486cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104628015 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104628016 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104628016 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104628016 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104628018 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104628018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104628018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104628018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:28.988464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27995): Terminating (SIGTERM) 10:46:29.030161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27998): Terminating (SIGTERM) 10:46:29.071884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28001): Terminating (SIGTERM) 10:46:29.114066 --- ParallelTerminationStrategy: PID 27995 died... 10:46:29.134097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27995): Terminated: ok {rc=0} 10:46:29.180562 --- ParallelTerminationStrategy: PID 27998 died... 10:46:29.200065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27998): Terminated: ok {rc=0} 10:46:29.246280 --- ParallelTerminationStrategy: PID 28001 died... 10:46:29.265815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28001): Terminated: ok {rc=0} 10:46:29.354144 bus /sierra_3: Setting Powered False 10:46:30.453172 bus /sierra_3: Setting Powered False 10:46:31.576563 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 10:46:32.676705 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:32.688613 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:46:32.735459 tst emergency_preemptive_call.py: using LAC 20929 10:46:32.861107 tst emergency_preemptive_call.py: using RAC 19 10:46:32.985161 tst emergency_preemptive_call.py: using CellId 20929 10:46:33.108224 tst emergency_preemptive_call.py: using BVCI 20930 10:46:33.224524 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:33.235819 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:33.246840 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:33.258133 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:33.269576 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:46:33.280753 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:33.395593 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:33.512923 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:33.630359 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:33.748515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:34.247430 run create_hlr_db(pid=28004): Launched 10:46:34.372095 bus /sierra_2: Setting Powered False 10:46:35.433157 run create_hlr_db(pid=28004): Terminated: ok {rc=0} 10:46:35.881109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28006): Launched 10:46:36.204123 run osmo-hlr_10.42.42.2(pid=28007): Launched 10:46:36.328012 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:36.891087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28009): Launched 10:46:37.214038 run osmo-stp_10.42.42.5(pid=28010): Launched 10:46:37.345586 tst emergency_preemptive_call.py: using MSISDN 7165 10:46:37.511776 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:38.087046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28012): Launched 10:46:38.408423 run osmo-msc_10.42.42.6(pid=28013): Launched 10:46:38.590147 run osmo-stp_10.42.42.5(pid=28010): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28010)] 10:46:38.725454 run osmo-stp_10.42.42.5(pid=28010): stdout: | (launched: 2022-12-09_10:46:37.154714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:38.861361 run osmo-stp_10.42.42.5(pid=28010): stderr: | 20221209104637347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104637347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104637348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104637348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104637349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104637349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104637349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:38.996753 run osmo-stp_10.42.42.5(pid=28010): stdout: | (launched: 2022-12-09_10:46:37.154714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:39.124806 run osmo-stp_10.42.42.5(pid=28010): stderr: | 20221209104637347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104637347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104637348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104637348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104637349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104637349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104637349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:39.277349 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28010): Process ended prematurely: osmo-stp_10.42.42.5(pid=28010) [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28010)] [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 10:46:39.286515 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 10:46:39.315033 run osmo-hlr_10.42.42.2(pid=28007): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28007)] 10:46:39.365530 run osmo-hlr_10.42.42.2(pid=28007): stdout: | (launched: 2022-12-09_10:46:36.144659) 10:46:39.418028 run osmo-hlr_10.42.42.2(pid=28007): stderr: | 20221209104636345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104636345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104636345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104636345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104636345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104636345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104636356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104636365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104636365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104636365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:39.491609 run osmo-msc_10.42.42.6(pid=28013): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28013)] 10:46:39.542175 run osmo-msc_10.42.42.6(pid=28013): stdout: | (launched: 2022-12-09_10:46:38.349271) 10:46:39.594474 run osmo-msc_10.42.42.6(pid=28013): stderr: | 20221209104638670 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209104638670 DLGLOBAL DEBUG validating counter group 0x7f339d915c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209104638670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209104638670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209104638670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209104638670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209104638673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209104638673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209104638674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209104638674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:39.647110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28006): Terminating (SIGTERM) 10:46:39.688942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28009): Terminating (SIGTERM) 10:46:39.731603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28012): Terminating (SIGTERM) 10:46:39.774094 --- ParallelTerminationStrategy: PID 28006 died... 10:46:39.794186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28006): Terminated: ok {rc=0} 10:46:39.841151 --- ParallelTerminationStrategy: PID 28009 died... 10:46:39.860598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28009): Terminated: ok {rc=0} 10:46:39.907559 --- ParallelTerminationStrategy: PID 28012 died... 10:46:39.927281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28012): Terminated: ok {rc=0} 10:46:40.015692 bus /sierra_9: Setting Powered False 10:46:41.114696 bus /sierra_9: Setting Powered False 10:46:42.230734 bus /sierra_8: Setting Powered False 10:46:43.329461 bus /sierra_8: Setting Powered False 10:46:44.445687 bus /sierra_3: Setting Powered False 10:46:45.540937 bus /sierra_3: Setting Powered False 10:46:46.663540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 10:46:47.954226 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:47.959035 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:46:47.989098 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 10:46:48.028473 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 10:46:48.116822 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:46:48.146844 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 10:46:48.186131 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 10:46:48.773444 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 10:46:48.824657 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:48.835559 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:46:48.881651 tst cs_paging_gprs_active.py: using LAC 20930 10:46:49.004027 tst cs_paging_gprs_active.py: using RAC 20 10:46:49.126417 tst cs_paging_gprs_active.py: using CellId 20930 10:46:49.246864 tst cs_paging_gprs_active.py: using BVCI 20931 10:46:49.358944 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.369673 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.380206 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.390685 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.401069 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.411428 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.422019 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.432380 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:46:49.442948 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:49.561620 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:46:49.678576 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:46:49.883994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:50.191638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28020): Launched 10:46:50.458563 run iperf3-srv_10.42.42.10(pid=28021): Launched 10:46:50.574900 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:46:50.779264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:51.085217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28022): Launched 10:46:51.351022 run iperf3-srv_10.42.42.10(pid=28023): Launched 10:46:51.467597 tst cs_paging_gprs_active.py:38: start network... 10:46:51.670246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:52.141553 run create_hlr_db(pid=28024): Launched 10:46:52.267190 bus /sierra_2: Setting Powered False 10:46:53.328076 run create_hlr_db(pid=28024): Terminated: ok {rc=0} 10:46:53.752176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28026): Launched 10:46:54.059555 run osmo-hlr_10.42.42.2(pid=28027): Launched 10:46:54.177778 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:54.703707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28029): Launched 10:46:55.009143 run osmo-stp_10.42.42.5(pid=28030): Launched 10:46:55.126365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:55.655797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28032): Launched 10:46:55.774216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:56.031587 run patchelf(pid=28033): Launched 10:46:56.203544 run osmo-stp_10.42.42.5(pid=28030): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28030)] 10:46:56.332147 run osmo-stp_10.42.42.5(pid=28030): stdout: | (launched: 2022-12-09_10:46:54.952305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:56.462338 run osmo-stp_10.42.42.5(pid=28030): stderr: | 20221209104655123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104655123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104655123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104655124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104655124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104655125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104655125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:56.592296 run osmo-stp_10.42.42.5(pid=28030): stdout: | (launched: 2022-12-09_10:46:54.952305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:56.717102 run osmo-stp_10.42.42.5(pid=28030): stderr: | 20221209104655123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104655123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104655123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104655124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104655124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104655125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104655125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:56.864844 run patchelf(pid=28033): Terminating (SIGINT) 10:46:57.035582 run patchelf(pid=28033): Terminated: ok {rc=0} 10:46:57.159031 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28030): Process ended prematurely: osmo-stp_10.42.42.5(pid=28030) [trial-2358↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28030)] [trial-2358↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 10:46:57.168597 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:46:57.196017 run osmo-hlr_10.42.42.2(pid=28027): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28027)] 10:46:57.243230 run osmo-hlr_10.42.42.2(pid=28027): stdout: | (launched: 2022-12-09_10:46:54.002555) 10:46:57.291955 run osmo-hlr_10.42.42.2(pid=28027): stderr: | 20221209104654180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104654180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104654180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104654180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104654180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104654180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104654195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104654206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104654206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104654206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:57.341177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28020): Terminating (SIGTERM) 10:46:57.380480 run iperf3-srv_10.42.42.10(pid=28021): Terminating (SIGTERM) 10:46:57.419663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28022): Terminating (SIGTERM) 10:46:57.458967 run iperf3-srv_10.42.42.10(pid=28023): Terminating (SIGTERM) 10:46:57.498074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28026): Terminating (SIGTERM) 10:46:57.537413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28029): Terminating (SIGTERM) 10:46:57.576650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28032): Terminating (SIGTERM) 10:46:57.616282 --- ParallelTerminationStrategy: PID 28020 died... 10:46:57.635428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28020): Terminated: ok {rc=0} 10:46:57.678953 --- ParallelTerminationStrategy: PID 28021 died... 10:46:57.697568 run iperf3-srv_10.42.42.10(pid=28021): Terminated {rc=256} 10:46:57.740919 --- ParallelTerminationStrategy: PID 28022 died... 10:46:57.759848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28022): Terminated: ok {rc=0} 10:46:57.803325 --- ParallelTerminationStrategy: PID 28023 died... 10:46:57.822262 run iperf3-srv_10.42.42.10(pid=28023): Terminated {rc=256} 10:46:57.865612 --- ParallelTerminationStrategy: PID 28026 died... 10:46:57.884062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28026): Terminated: ok {rc=0} 10:46:57.927494 --- ParallelTerminationStrategy: PID 28029 died... 10:46:57.946183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28029): Terminated: ok {rc=0} 10:46:57.989793 --- ParallelTerminationStrategy: PID 28032 died... 10:46:58.008352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28032): Terminated: ok {rc=0} 10:46:58.098392 bus /gobi_0: Setting Powered False 10:46:59.198784 bus /gobi_0: Setting Powered False 10:47:00.313361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 10:47:01.456072 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:01.468156 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:47:01.516263 tst iperf3.py: using LAC 20931 10:47:01.667087 tst iperf3.py: using RAC 21 10:47:01.789585 tst iperf3.py: using CellId 20931 10:47:01.925109 tst iperf3.py: using BVCI 20932 10:47:02.048543 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.061060 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.073343 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.086358 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.099496 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.112233 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.125618 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.139527 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:02.152887 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:02.272161 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:47:02.504615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:02.833123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28034): Launched 10:47:03.119141 run iperf3-srv_10.42.42.10(pid=28035): Launched 10:47:03.241740 tst iperf3.py:8: start network... 10:47:03.460471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:03.967343 run create_hlr_db(pid=28036): Launched 10:47:04.094256 bus /gobi_6: Setting Powered False 10:47:05.158772 run create_hlr_db(pid=28036): Terminated: ok {rc=0} 10:47:05.592369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28038): Launched 10:47:05.896805 run osmo-hlr_10.42.42.2(pid=28039): Launched 10:47:06.013878 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:06.539949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28041): Launched 10:47:06.843505 run osmo-stp_10.42.42.5(pid=28042): Launched 10:47:06.959723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:07.489350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28044): Launched 10:47:07.605912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:07.863968 run patchelf(pid=28045): Launched 10:47:08.032918 run osmo-stp_10.42.42.5(pid=28042): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28042)] 10:47:08.161246 run osmo-stp_10.42.42.5(pid=28042): stdout: | (launched: 2022-12-09_10:47:06.786839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:08.291081 run osmo-stp_10.42.42.5(pid=28042): stderr: | 20221209104706959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104706959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104706959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104706959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104706960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104706960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104706960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:08.420747 run osmo-stp_10.42.42.5(pid=28042): stdout: | (launched: 2022-12-09_10:47:06.786839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:08.545367 run osmo-stp_10.42.42.5(pid=28042): stderr: | 20221209104706959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104706959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104706959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104706959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104706960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104706960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104706960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:08.692727 run patchelf(pid=28045): Terminating (SIGINT) 10:47:08.863549 run patchelf(pid=28045): Terminated: ok {rc=0} 10:47:08.985872 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28042): Process ended prematurely: osmo-stp_10.42.42.5(pid=28042) [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28042)] [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 10:47:08.995318 tst iperf3.py:8: Test FAILED (7.6 sec) 10:47:09.022930 run osmo-hlr_10.42.42.2(pid=28039): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28039)] 10:47:09.070568 run osmo-hlr_10.42.42.2(pid=28039): stdout: | (launched: 2022-12-09_10:47:05.840210) 10:47:09.120138 run osmo-hlr_10.42.42.2(pid=28039): stderr: | 20221209104706017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104706017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104706017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104706017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104706017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104706018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104706032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104706043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104706043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104706043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:09.170186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28034): Terminating (SIGTERM) 10:47:09.210192 run iperf3-srv_10.42.42.10(pid=28035): Terminating (SIGTERM) 10:47:09.250412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28038): Terminating (SIGTERM) 10:47:09.290404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28041): Terminating (SIGTERM) 10:47:09.330209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28044): Terminating (SIGTERM) 10:47:09.370280 --- ParallelTerminationStrategy: PID 28034 died... 10:47:09.389550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28034): Terminated: ok {rc=0} 10:47:09.433766 --- ParallelTerminationStrategy: PID 28035 died... 10:47:09.452593 run iperf3-srv_10.42.42.10(pid=28035): Terminated {rc=256} 10:47:09.497415 --- ParallelTerminationStrategy: PID 28038 died... 10:47:09.516384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28038): Terminated: ok {rc=0} 10:47:09.560569 --- ParallelTerminationStrategy: PID 28041 died... 10:47:09.579455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28041): Terminated: ok {rc=0} 10:47:09.623680 --- ParallelTerminationStrategy: PID 28044 died... 10:47:09.642605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28044): Terminated: ok {rc=0} 10:47:09.728526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 10:47:10.876477 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:10.887917 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:47:10.933540 tst iperf3m4.py: using LAC 20932 10:47:11.054240 tst iperf3m4.py: using RAC 22 10:47:11.172206 tst iperf3m4.py: using CellId 20932 10:47:11.292140 tst iperf3m4.py: using BVCI 20933 10:47:11.404565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.415421 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.426060 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.436542 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.447096 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.457600 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.468230 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.478700 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:11.489374 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:11.604181 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:11.725476 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:11.842798 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:11.966029 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:47:12.186598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:12.515864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28046): Launched 10:47:12.800776 run iperf3-srv_10.42.42.10(pid=28047): Launched 10:47:12.925305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:47:13.144320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:13.472133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28048): Launched 10:47:13.756422 run iperf3-srv_10.42.42.10(pid=28049): Launched 10:47:13.880661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:47:14.099076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:14.427390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28050): Launched 10:47:14.711613 run iperf3-srv_10.42.42.10(pid=28051): Launched 10:47:14.835281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:47:15.054369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:15.382741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28052): Launched 10:47:15.669632 run iperf3-srv_10.42.42.10(pid=28053): Launched 10:47:15.793100 tst iperf3m4.py:8: start network... 10:47:16.026713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:16.547564 run create_hlr_db(pid=28054): Launched 10:47:16.707926 bus /gobi_6: Setting Powered False 10:47:17.772471 run create_hlr_db(pid=28054): Terminated: ok {rc=0} 10:47:18.225388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28056): Launched 10:47:18.555152 run osmo-hlr_10.42.42.2(pid=28057): Launched 10:47:18.681617 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:19.352672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28059): Launched 10:47:19.672681 run osmo-stp_10.42.42.5(pid=28060): Launched 10:47:19.794840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:20.347090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28062): Launched 10:47:20.470974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:20.743114 run patchelf(pid=28063): Launched 10:47:20.920863 run osmo-stp_10.42.42.5(pid=28060): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28060)] 10:47:21.055899 run osmo-stp_10.42.42.5(pid=28060): stdout: | (launched: 2022-12-09_10:47:19.613578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:21.192515 run osmo-stp_10.42.42.5(pid=28060): stderr: | 20221209104719802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104719802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104719803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104719803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104719804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104719804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104719804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:21.329244 run osmo-stp_10.42.42.5(pid=28060): stdout: | (launched: 2022-12-09_10:47:19.613578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:21.460880 run osmo-stp_10.42.42.5(pid=28060): stderr: | 20221209104719802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104719802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104719803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104719803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104719804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104719804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104719804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:21.616924 run patchelf(pid=28063): Terminating (SIGINT) 10:47:21.795910 run patchelf(pid=28063): Terminated: ok {rc=0} 10:47:21.925066 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28060): Process ended prematurely: osmo-stp_10.42.42.5(pid=28060) [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28060)] [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 10:47:21.935647 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:47:21.965383 run osmo-hlr_10.42.42.2(pid=28057): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28057)] 10:47:22.015752 run osmo-hlr_10.42.42.2(pid=28057): stdout: | (launched: 2022-12-09_10:47:18.494482) 10:47:22.067897 run osmo-hlr_10.42.42.2(pid=28057): stderr: | 20221209104718693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104718693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104718693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104718693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104718693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104718694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104718706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104718716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104718716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104718716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:22.120420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28046): Terminating (SIGTERM) 10:47:22.162348 run iperf3-srv_10.42.42.10(pid=28047): Terminating (SIGTERM) 10:47:22.204210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28048): Terminating (SIGTERM) 10:47:22.246052 run iperf3-srv_10.42.42.10(pid=28049): Terminating (SIGTERM) 10:47:22.287801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28050): Terminating (SIGTERM) 10:47:22.329728 run iperf3-srv_10.42.42.10(pid=28051): Terminating (SIGTERM) 10:47:22.371404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28052): Terminating (SIGTERM) 10:47:22.413198 run iperf3-srv_10.42.42.10(pid=28053): Terminating (SIGTERM) 10:47:22.454978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28056): Terminating (SIGTERM) 10:47:22.497148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28059): Terminating (SIGTERM) 10:47:22.539187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28062): Terminating (SIGTERM) 10:47:22.581317 --- ParallelTerminationStrategy: PID 28046 died... 10:47:22.601403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28046): Terminated: ok {rc=0} 10:47:22.647825 --- ParallelTerminationStrategy: PID 28047 died... 10:47:22.667325 run iperf3-srv_10.42.42.10(pid=28047): Terminated {rc=256} 10:47:22.713696 --- ParallelTerminationStrategy: PID 28048 died... 10:47:22.733185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28048): Terminated: ok {rc=0} 10:47:22.779419 --- ParallelTerminationStrategy: PID 28049 died... 10:47:22.798832 run iperf3-srv_10.42.42.10(pid=28049): Terminated {rc=256} 10:47:22.845196 --- ParallelTerminationStrategy: PID 28050 died... 10:47:22.864697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28050): Terminated: ok {rc=0} 10:47:22.911108 --- ParallelTerminationStrategy: PID 28051 died... 10:47:22.930582 run iperf3-srv_10.42.42.10(pid=28051): Terminated {rc=256} 10:47:22.977409 --- ParallelTerminationStrategy: PID 28052 died... 10:47:22.996941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28052): Terminated: ok {rc=0} 10:47:23.043106 --- ParallelTerminationStrategy: PID 28053 died... 10:47:23.062738 run iperf3-srv_10.42.42.10(pid=28053): Terminated {rc=256} 10:47:23.109049 --- ParallelTerminationStrategy: PID 28056 died... 10:47:23.128528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28056): Terminated: ok {rc=0} 10:47:23.174635 --- ParallelTerminationStrategy: PID 28059 died... 10:47:23.194090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28059): Terminated: ok {rc=0} 10:47:23.240240 --- ParallelTerminationStrategy: PID 28062 died... 10:47:23.259753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28062): Terminated: ok {rc=0} 10:47:23.348840 bus /gobi_4: Setting Powered False 10:47:24.447361 bus /gobi_4: Setting Powered False 10:47:25.564466 bus /gobi_1: Setting Powered False 10:47:26.662801 bus /gobi_1: Setting Powered False 10:47:27.778883 bus /gobi_0: Setting Powered False 10:47:28.876481 bus /gobi_0: Setting Powered False 10:47:29.993080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 10:47:31.121755 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.134538 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:47:31.183948 tst ping.py: using LAC 20933 10:47:31.349811 tst ping.py: using RAC 23 10:47:31.476239 tst ping.py: using CellId 20933 10:47:31.603839 tst ping.py: using BVCI 20934 10:47:31.715921 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.726857 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.737565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.748217 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.760412 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.772414 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.784138 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:31.795845 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:31.913713 tst ping.py:19: start network... 10:47:32.115902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:32.572025 run create_hlr_db(pid=28064): Launched 10:47:32.694403 bus /gobi_6: Setting Powered False 10:47:33.753198 run create_hlr_db(pid=28064): Terminated: ok {rc=0} 10:47:34.183188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28066): Launched 10:47:34.481656 run osmo-hlr_10.42.42.2(pid=28067): Launched 10:47:34.594502 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:35.107605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28069): Launched 10:47:35.401267 run osmo-stp_10.42.42.5(pid=28070): Launched 10:47:35.512904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:36.022463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28073): Launched 10:47:36.134246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:36.381792 run patchelf(pid=28074): Launched 10:47:36.544695 run osmo-stp_10.42.42.5(pid=28070): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28070)] 10:47:36.668865 run osmo-stp_10.42.42.5(pid=28070): stdout: | (launched: 2022-12-09_10:47:35.346720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:36.794674 run osmo-stp_10.42.42.5(pid=28070): stderr: | 20221209104735515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104735515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104735515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104735516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104735516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104735516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104735516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:36.920251 run osmo-stp_10.42.42.5(pid=28070): stdout: | (launched: 2022-12-09_10:47:35.346720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:37.040178 run osmo-stp_10.42.42.5(pid=28070): stderr: | 20221209104735515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104735515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104735515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104735516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104735516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104735516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104735516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:37.183020 run patchelf(pid=28074): Terminating (SIGINT) 10:47:37.347308 run patchelf(pid=28074): Terminated: ok {rc=0} 10:47:37.467090 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28070): Process ended prematurely: osmo-stp_10.42.42.5(pid=28070) [trial-2358↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28070)] [trial-2358↪gprs:trx-lms-limenet-micro↪ping.py:22] 10:47:37.476046 tst ping.py:22: Test FAILED (6.3 sec) 10:47:37.502821 run osmo-hlr_10.42.42.2(pid=28067): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28067)] 10:47:37.550198 run osmo-hlr_10.42.42.2(pid=28067): stdout: | (launched: 2022-12-09_10:47:34.426991) 10:47:37.599336 run osmo-hlr_10.42.42.2(pid=28067): stderr: | 20221209104734599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104734599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104734599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104734599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104734599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104734599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104734611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104734622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104734623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104734623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:37.649331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28066): Terminating (SIGTERM) 10:47:37.688716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28069): Terminating (SIGTERM) 10:47:37.728238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28073): Terminating (SIGTERM) 10:47:37.768064 --- ParallelTerminationStrategy: PID 28066 died... 10:47:37.787064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28066): Terminated: ok {rc=0} 10:47:37.831104 --- ParallelTerminationStrategy: PID 28069 died... 10:47:37.849786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28069): Terminated: ok {rc=0} 10:47:37.894205 --- ParallelTerminationStrategy: PID 28073 died... 10:47:37.912617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28073): Terminated: ok {rc=0} 10:47:37.996758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 10:47:39.082250 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.093548 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:47:39.138968 tst ping_idle_ping.py: using LAC 20934 10:47:39.256129 tst ping_idle_ping.py: using RAC 24 10:47:39.376454 tst ping_idle_ping.py: using CellId 20934 10:47:39.492445 tst ping_idle_ping.py: using BVCI 20935 10:47:39.599482 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.610210 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.620737 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.631337 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.641782 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.652272 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.662866 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:47:39.673390 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:47:39.793148 tst ping_idle_ping.py:24: start network... 10:47:40.005724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:40.496253 run create_hlr_db(pid=28075): Launched 10:47:40.617966 bus /gobi_6: Setting Powered False 10:47:41.680136 run create_hlr_db(pid=28075): Terminated: ok {rc=0} 10:47:42.103505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Launched 10:47:42.399553 run osmo-hlr_10.42.42.2(pid=28078): Launched 10:47:42.512057 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:43.022776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Launched 10:47:43.318955 run osmo-stp_10.42.42.5(pid=28081): Launched 10:47:43.431479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:43.944262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28083): Launched 10:47:44.057727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:44.307123 run patchelf(pid=28084): Launched 10:47:44.471092 run osmo-stp_10.42.42.5(pid=28081): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] 10:47:44.595545 run osmo-stp_10.42.42.5(pid=28081): stdout: | (launched: 2022-12-09_10:47:43.263650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:44.721249 run osmo-stp_10.42.42.5(pid=28081): stderr: | 20221209104743432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104743432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104743432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104743433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104743433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104743433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104743433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:44.847064 run osmo-stp_10.42.42.5(pid=28081): stdout: | (launched: 2022-12-09_10:47:43.263650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:44.967237 run osmo-stp_10.42.42.5(pid=28081): stderr: | 20221209104743432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104743432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104743432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104743433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104743433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104743433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104743433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:45.110113 run patchelf(pid=28084): Terminating (SIGINT) 10:47:45.274946 run patchelf(pid=28084): Terminated: ok {rc=0} 10:47:45.393946 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28081): Process ended prematurely: osmo-stp_10.42.42.5(pid=28081) [trial-2358↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] [trial-2358↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 10:47:45.402804 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:47:45.429363 run osmo-hlr_10.42.42.2(pid=28078): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28078)] 10:47:45.476707 run osmo-hlr_10.42.42.2(pid=28078): stdout: | (launched: 2022-12-09_10:47:42.344322) 10:47:45.526253 run osmo-hlr_10.42.42.2(pid=28078): stderr: | 20221209104742520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104742520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104742520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104742520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104742520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104742520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104742545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104742555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104742555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104742555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:45.575905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Terminating (SIGTERM) 10:47:45.615199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Terminating (SIGTERM) 10:47:45.654552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28083): Terminating (SIGTERM) 10:47:45.694238 --- ParallelTerminationStrategy: PID 28077 died... 10:47:45.713034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Terminated: ok {rc=0} 10:47:45.756828 --- ParallelTerminationStrategy: PID 28080 died... 10:47:45.775693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Terminated: ok {rc=0} 10:47:45.818912 --- ParallelTerminationStrategy: PID 28083 died... 10:47:45.837413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28083): Terminated: ok {rc=0} 10:47:45.949724 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 10:47:47.280742 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:47:47.287482 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:47:47.320741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:47:47.360559 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:47:47.446757 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:47:47.475080 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:47:47.512553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:47:48.107139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:47:48.155820 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.166831 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:47:48.212704 tst cs_paging_gprs_active.py: using LAC 20935 10:47:48.330907 tst cs_paging_gprs_active.py: using RAC 25 10:47:48.450380 tst cs_paging_gprs_active.py: using CellId 20935 10:47:48.569729 tst cs_paging_gprs_active.py: using BVCI 20936 10:47:48.688833 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.700297 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.711446 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.722949 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.734319 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.745732 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.757284 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.768597 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:47:48.780206 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:47:48.896228 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:47:49.011496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:47:49.213588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:49.516156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28088): Launched 10:47:49.779394 run iperf3-srv_10.42.42.10(pid=28089): Launched 10:47:49.894165 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:47:50.093838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:50.394771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28090): Launched 10:47:50.658090 run iperf3-srv_10.42.42.10(pid=28091): Launched 10:47:50.773637 tst cs_paging_gprs_active.py:38: start network... 10:47:50.974765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:51.444258 run create_hlr_db(pid=28092): Launched 10:47:51.568820 bus /gobi_6: Setting Powered False 10:47:52.627842 run create_hlr_db(pid=28092): Terminated: ok {rc=0} 10:47:53.067471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28094): Launched 10:47:53.389204 run osmo-hlr_10.42.42.2(pid=28095): Launched 10:47:53.515187 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:54.072716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28097): Launched 10:47:54.394654 run osmo-stp_10.42.42.5(pid=28098): Launched 10:47:54.518895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:55.077597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28100): Launched 10:47:55.201209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:55.475224 run patchelf(pid=28101): Launched 10:47:55.654763 run osmo-stp_10.42.42.5(pid=28098): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28098)] 10:47:55.790676 run osmo-stp_10.42.42.5(pid=28098): stdout: | (launched: 2022-12-09_10:47:54.334906) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:55.927820 run osmo-stp_10.42.42.5(pid=28098): stderr: | 20221209104754524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104754525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104754525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104754525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104754526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104754526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104754526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:56.065199 run osmo-stp_10.42.42.5(pid=28098): stdout: | (launched: 2022-12-09_10:47:54.334906) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:56.197149 run osmo-stp_10.42.42.5(pid=28098): stderr: | 20221209104754524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104754525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104754525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104754525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104754526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104754526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104754526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:56.353135 run patchelf(pid=28101): Terminating (SIGINT) 10:47:56.533509 run patchelf(pid=28101): Terminated: ok {rc=0} 10:47:56.663417 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28098): Process ended prematurely: osmo-stp_10.42.42.5(pid=28098) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28098)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:47:56.673741 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:47:56.702955 run osmo-hlr_10.42.42.2(pid=28095): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28095)] 10:47:56.753317 run osmo-hlr_10.42.42.2(pid=28095): stdout: | (launched: 2022-12-09_10:47:53.330252) 10:47:56.805375 run osmo-hlr_10.42.42.2(pid=28095): stderr: | 20221209104753527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104753527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104753527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104753527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104753527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104753527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104753539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104753548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104753548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104753548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:56.858094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28088): Terminating (SIGTERM) 10:47:56.900156 run iperf3-srv_10.42.42.10(pid=28089): Terminating (SIGTERM) 10:47:56.942125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28090): Terminating (SIGTERM) 10:47:56.984103 run iperf3-srv_10.42.42.10(pid=28091): Terminating (SIGTERM) 10:47:57.025811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28094): Terminating (SIGTERM) 10:47:57.067696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28097): Terminating (SIGTERM) 10:47:57.109686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28100): Terminating (SIGTERM) 10:47:57.151698 --- ParallelTerminationStrategy: PID 28088 died... 10:47:57.171609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28088): Terminated: ok {rc=0} 10:47:57.218560 --- ParallelTerminationStrategy: PID 28089 died... 10:47:57.237872 run iperf3-srv_10.42.42.10(pid=28089): Terminated {rc=256} 10:47:57.284082 --- ParallelTerminationStrategy: PID 28090 died... 10:47:57.303471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28090): Terminated: ok {rc=0} 10:47:57.349699 --- ParallelTerminationStrategy: PID 28091 died... 10:47:57.369455 run iperf3-srv_10.42.42.10(pid=28091): Terminated {rc=256} 10:47:57.415737 --- ParallelTerminationStrategy: PID 28094 died... 10:47:57.435202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28094): Terminated: ok {rc=0} 10:47:57.481530 --- ParallelTerminationStrategy: PID 28097 died... 10:47:57.501669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28097): Terminated: ok {rc=0} 10:47:57.548302 --- ParallelTerminationStrategy: PID 28100 died... 10:47:57.567647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28100): Terminated: ok {rc=0} 10:47:57.655559 bus /gobi_0: Setting Powered False 10:47:58.754642 bus /gobi_0: Setting Powered False 10:47:59.871272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:48:01.038808 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.052079 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:48:01.106871 tst iperf3.py: using LAC 20936 10:48:01.235346 tst iperf3.py: using RAC 26 10:48:01.365325 tst iperf3.py: using CellId 20936 10:48:01.524165 tst iperf3.py: using BVCI 20937 10:48:01.639117 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.650813 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.662115 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.674687 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.686493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.698126 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.710033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.721188 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:01.732577 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:01.871855 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:48:02.106437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:02.411130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28102): Launched 10:48:02.673672 run iperf3-srv_10.42.42.10(pid=28103): Launched 10:48:02.786956 tst iperf3.py:8: start network... 10:48:02.987491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:03.455865 run create_hlr_db(pid=28104): Launched 10:48:03.580835 bus /gobi_6: Setting Powered False 10:48:04.640928 run create_hlr_db(pid=28104): Terminated: ok {rc=0} 10:48:05.058802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28106): Launched 10:48:05.359143 run osmo-hlr_10.42.42.2(pid=28107): Launched 10:48:05.472770 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:05.987450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28109): Launched 10:48:06.286018 run osmo-stp_10.42.42.5(pid=28110): Launched 10:48:06.400110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:06.915129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28112): Launched 10:48:07.029571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:07.282584 run patchelf(pid=28113): Launched 10:48:07.448502 run osmo-stp_10.42.42.5(pid=28110): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28110)] 10:48:07.575618 run osmo-stp_10.42.42.5(pid=28110): stdout: | (launched: 2022-12-09_10:48:06.230635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:07.703755 run osmo-stp_10.42.42.5(pid=28110): stderr: | 20221209104806398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104806398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104806398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104806399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104806399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104806399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104806399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:07.831768 run osmo-stp_10.42.42.5(pid=28110): stdout: | (launched: 2022-12-09_10:48:06.230635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:07.954205 run osmo-stp_10.42.42.5(pid=28110): stderr: | 20221209104806398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104806398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104806398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104806399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104806399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104806399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104806399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:08.099283 run patchelf(pid=28113): Terminating (SIGINT) 10:48:08.267367 run patchelf(pid=28113): Terminated: ok {rc=0} 10:48:08.388164 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28110): Process ended prematurely: osmo-stp_10.42.42.5(pid=28110) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28110)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 10:48:08.397871 tst iperf3.py:8: Test FAILED (7.4 sec) 10:48:08.425206 run osmo-hlr_10.42.42.2(pid=28107): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28107)] 10:48:08.472684 run osmo-hlr_10.42.42.2(pid=28107): stdout: | (launched: 2022-12-09_10:48:05.303001) 10:48:08.521997 run osmo-hlr_10.42.42.2(pid=28107): stderr: | 20221209104805479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104805479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104805479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104805479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104805479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104805479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104805491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104805502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104805502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104805502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:08.571552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28102): Terminating (SIGTERM) 10:48:08.611411 run iperf3-srv_10.42.42.10(pid=28103): Terminating (SIGTERM) 10:48:08.651169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28106): Terminating (SIGTERM) 10:48:08.690981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28109): Terminating (SIGTERM) 10:48:08.730637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28112): Terminating (SIGTERM) 10:48:08.770699 --- ParallelTerminationStrategy: PID 28102 died... 10:48:08.789576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28102): Terminated: ok {rc=0} 10:48:08.833571 --- ParallelTerminationStrategy: PID 28103 died... 10:48:08.852067 run iperf3-srv_10.42.42.10(pid=28103): Terminated {rc=256} 10:48:08.896094 --- ParallelTerminationStrategy: PID 28106 died... 10:48:08.914808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28106): Terminated: ok {rc=0} 10:48:08.958532 --- ParallelTerminationStrategy: PID 28109 died... 10:48:08.977158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28109): Terminated: ok {rc=0} 10:48:09.021127 --- ParallelTerminationStrategy: PID 28112 died... 10:48:09.039939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28112): Terminated: ok {rc=0} 10:48:09.125609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:48:10.272317 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.283929 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:48:10.330524 tst iperf3m4.py: using LAC 20937 10:48:10.449971 tst iperf3m4.py: using RAC 27 10:48:10.578307 tst iperf3m4.py: using CellId 20937 10:48:10.704700 tst iperf3m4.py: using BVCI 20938 10:48:10.822195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.833905 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.845409 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.857989 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.870118 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.883688 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.895175 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.905984 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:10.916790 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:11.038371 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:11.159336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:11.278560 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:11.398131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:48:11.615869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:11.939481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28114): Launched 10:48:12.219436 run iperf3-srv_10.42.42.10(pid=28115): Launched 10:48:12.341043 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:48:12.557892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:12.881526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28116): Launched 10:48:13.164259 run iperf3-srv_10.42.42.10(pid=28117): Launched 10:48:13.285579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:48:13.501572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:13.825649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28118): Launched 10:48:14.108110 run iperf3-srv_10.42.42.10(pid=28119): Launched 10:48:14.232023 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:48:14.448698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:14.773448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28120): Launched 10:48:15.055267 run iperf3-srv_10.42.42.10(pid=28121): Launched 10:48:15.178257 tst iperf3m4.py:8: start network... 10:48:15.394059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:15.932776 run create_hlr_db(pid=28122): Launched 10:48:16.080103 bus /gobi_6: Setting Powered False 10:48:17.141524 run create_hlr_db(pid=28122): Terminated: ok {rc=0} 10:48:17.576522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28124): Launched 10:48:17.880825 run osmo-hlr_10.42.42.2(pid=28125): Launched 10:48:17.996007 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:18.518512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28127): Launched 10:48:18.819108 run osmo-stp_10.42.42.5(pid=28128): Launched 10:48:18.937657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:19.457098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28130): Launched 10:48:19.571356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:19.826105 run patchelf(pid=28131): Launched 10:48:19.993399 run osmo-stp_10.42.42.5(pid=28128): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28128)] 10:48:20.119980 run osmo-stp_10.42.42.5(pid=28128): stdout: | (launched: 2022-12-09_10:48:18.763213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:20.248383 run osmo-stp_10.42.42.5(pid=28128): stderr: | 20221209104818931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104818931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104818931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104818932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104818932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104818932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104818932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:20.376747 run osmo-stp_10.42.42.5(pid=28128): stdout: | (launched: 2022-12-09_10:48:18.763213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:20.499891 run osmo-stp_10.42.42.5(pid=28128): stderr: | 20221209104818931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104818931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104818931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104818932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104818932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104818932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104818932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:20.645636 run patchelf(pid=28131): Terminating (SIGINT) 10:48:20.814116 run patchelf(pid=28131): Terminated: ok {rc=0} 10:48:20.935112 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28128): Process ended prematurely: osmo-stp_10.42.42.5(pid=28128) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28128)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 10:48:20.944691 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:48:20.972173 run osmo-hlr_10.42.42.2(pid=28125): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28125)] 10:48:21.019995 run osmo-hlr_10.42.42.2(pid=28125): stdout: | (launched: 2022-12-09_10:48:17.823779) 10:48:21.069761 run osmo-hlr_10.42.42.2(pid=28125): stderr: | 20221209104817999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104817999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104817999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104817999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104817999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104817999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104818011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104818020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104818020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104818020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:21.119972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28114): Terminating (SIGTERM) 10:48:21.159976 run iperf3-srv_10.42.42.10(pid=28115): Terminating (SIGTERM) 10:48:21.199841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28116): Terminating (SIGTERM) 10:48:21.239712 run iperf3-srv_10.42.42.10(pid=28117): Terminating (SIGTERM) 10:48:21.279464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28118): Terminating (SIGTERM) 10:48:21.319516 run iperf3-srv_10.42.42.10(pid=28119): Terminating (SIGTERM) 10:48:21.359324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28120): Terminating (SIGTERM) 10:48:21.399377 run iperf3-srv_10.42.42.10(pid=28121): Terminating (SIGTERM) 10:48:21.439135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28124): Terminating (SIGTERM) 10:48:21.479143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28127): Terminating (SIGTERM) 10:48:21.519000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28130): Terminating (SIGTERM) 10:48:21.559191 --- ParallelTerminationStrategy: PID 28114 died... 10:48:21.578373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28114): Terminated: ok {rc=0} 10:48:21.622807 --- ParallelTerminationStrategy: PID 28115 died... 10:48:21.641263 run iperf3-srv_10.42.42.10(pid=28115): Terminated {rc=256} 10:48:21.685167 --- ParallelTerminationStrategy: PID 28116 died... 10:48:21.703603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28116): Terminated: ok {rc=0} 10:48:21.747244 --- ParallelTerminationStrategy: PID 28117 died... 10:48:21.765696 run iperf3-srv_10.42.42.10(pid=28117): Terminated {rc=256} 10:48:21.809543 --- ParallelTerminationStrategy: PID 28118 died... 10:48:21.828251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28118): Terminated: ok {rc=0} 10:48:21.871902 --- ParallelTerminationStrategy: PID 28119 died... 10:48:21.890434 run iperf3-srv_10.42.42.10(pid=28119): Terminated {rc=256} 10:48:21.933963 --- ParallelTerminationStrategy: PID 28120 died... 10:48:21.952556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28120): Terminated: ok {rc=0} 10:48:21.996198 --- ParallelTerminationStrategy: PID 28121 died... 10:48:22.014837 run iperf3-srv_10.42.42.10(pid=28121): Terminated {rc=256} 10:48:22.058197 --- ParallelTerminationStrategy: PID 28124 died... 10:48:22.076884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28124): Terminated: ok {rc=0} 10:48:22.120497 --- ParallelTerminationStrategy: PID 28127 died... 10:48:22.139067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28127): Terminated: ok {rc=0} 10:48:22.182534 --- ParallelTerminationStrategy: PID 28130 died... 10:48:22.201107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28130): Terminated: ok {rc=0} 10:48:22.284545 bus /gobi_4: Setting Powered False 10:48:23.382555 bus /gobi_4: Setting Powered False 10:48:24.499682 bus /gobi_1: Setting Powered False 10:48:25.598343 bus /gobi_1: Setting Powered False 10:48:26.714187 bus /gobi_0: Setting Powered False 10:48:27.813056 bus /gobi_0: Setting Powered False 10:48:28.930757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 10:48:30.034340 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.046857 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:48:30.095475 tst ping.py: using LAC 20938 10:48:30.220330 tst ping.py: using RAC 28 10:48:30.348272 tst ping.py: using CellId 20938 10:48:30.463779 tst ping.py: using BVCI 20939 10:48:30.570404 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.581617 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.592411 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.603446 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.614283 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.625095 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.636094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:30.646838 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:30.758921 tst ping.py:19: start network... 10:48:30.981055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:31.515689 run create_hlr_db(pid=28132): Launched 10:48:31.676940 bus /gobi_6: Setting Powered False 10:48:32.739121 run create_hlr_db(pid=28132): Terminated: ok {rc=0} 10:48:33.159558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28134): Launched 10:48:33.453282 run osmo-hlr_10.42.42.2(pid=28135): Launched 10:48:33.564510 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:34.075543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28137): Launched 10:48:34.369421 run osmo-stp_10.42.42.5(pid=28138): Launched 10:48:34.481520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:34.992157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28140): Launched 10:48:35.104757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:35.353434 run patchelf(pid=28141): Launched 10:48:35.518179 run osmo-stp_10.42.42.5(pid=28138): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28138)] 10:48:35.643663 run osmo-stp_10.42.42.5(pid=28138): stdout: | (launched: 2022-12-09_10:48:34.314458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:35.770237 run osmo-stp_10.42.42.5(pid=28138): stderr: | 20221209104834483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104834483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104834483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104834484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104834484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104834484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104834484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:35.897425 run osmo-stp_10.42.42.5(pid=28138): stdout: | (launched: 2022-12-09_10:48:34.314458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:36.019701 run osmo-stp_10.42.42.5(pid=28138): stderr: | 20221209104834483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104834483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104834483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104834484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104834484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104834484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104834484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:36.163524 run patchelf(pid=28141): Terminating (SIGINT) 10:48:36.329352 run patchelf(pid=28141): Terminated: ok {rc=0} 10:48:36.449409 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28138): Process ended prematurely: osmo-stp_10.42.42.5(pid=28138) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28138)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 10:48:36.458356 tst ping.py:22: Test FAILED (6.4 sec) 10:48:36.485296 run osmo-hlr_10.42.42.2(pid=28135): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28135)] 10:48:36.533093 run osmo-hlr_10.42.42.2(pid=28135): stdout: | (launched: 2022-12-09_10:48:33.398871) 10:48:36.582617 run osmo-hlr_10.42.42.2(pid=28135): stderr: | 20221209104833575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104833575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104833575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104833575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104833575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104833575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104833587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104833595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104833595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104833595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:36.633116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28134): Terminating (SIGTERM) 10:48:36.672937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28137): Terminating (SIGTERM) 10:48:36.712819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28140): Terminating (SIGTERM) 10:48:36.753082 --- ParallelTerminationStrategy: PID 28134 died... 10:48:36.772263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28134): Terminated: ok {rc=0} 10:48:36.816730 --- ParallelTerminationStrategy: PID 28137 died... 10:48:36.835478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28137): Terminated: ok {rc=0} 10:48:36.880203 --- ParallelTerminationStrategy: PID 28140 died... 10:48:36.898793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28140): Terminated: ok {rc=0} 10:48:36.985236 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:48:38.076313 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.088490 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:48:38.138710 tst ping_idle_ping.py: using LAC 20939 10:48:38.266679 tst ping_idle_ping.py: using RAC 29 10:48:38.390442 tst ping_idle_ping.py: using CellId 20939 10:48:38.515078 tst ping_idle_ping.py: using BVCI 20940 10:48:38.632676 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.644389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.655695 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.667002 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.679690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.691915 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.704366 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:48:38.717226 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:48:38.835855 tst ping_idle_ping.py:24: start network... 10:48:39.047239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:39.538761 run create_hlr_db(pid=28142): Launched 10:48:39.659629 bus /gobi_6: Setting Powered False 10:48:40.721911 run create_hlr_db(pid=28142): Terminated: ok {rc=0} 10:48:41.144640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28144): Launched 10:48:41.463223 run osmo-hlr_10.42.42.2(pid=28145): Launched 10:48:41.585013 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:42.126590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28147): Launched 10:48:42.443669 run osmo-stp_10.42.42.5(pid=28148): Launched 10:48:42.565129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:43.110561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28150): Launched 10:48:43.231643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:43.498007 run patchelf(pid=28151): Launched 10:48:43.675507 run osmo-stp_10.42.42.5(pid=28148): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28148)] 10:48:43.809311 run osmo-stp_10.42.42.5(pid=28148): stdout: | (launched: 2022-12-09_10:48:42.384754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:43.943913 run osmo-stp_10.42.42.5(pid=28148): stderr: | 20221209104842574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104842575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104842575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104842575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104842576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104842576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104842576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:44.079710 run osmo-stp_10.42.42.5(pid=28148): stdout: | (launched: 2022-12-09_10:48:42.384754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:44.208670 run osmo-stp_10.42.42.5(pid=28148): stderr: | 20221209104842574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104842575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104842575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104842575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104842576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104842576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104842576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:44.362436 run patchelf(pid=28151): Terminating (SIGINT) 10:48:44.539149 run patchelf(pid=28151): Terminated: ok {rc=0} 10:48:44.666754 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28148): Process ended prematurely: osmo-stp_10.42.42.5(pid=28148) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28148)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 10:48:44.676441 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:48:44.705340 run osmo-hlr_10.42.42.2(pid=28145): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28145)] 10:48:44.755873 run osmo-hlr_10.42.42.2(pid=28145): stdout: | (launched: 2022-12-09_10:48:41.404602) 10:48:44.808161 run osmo-hlr_10.42.42.2(pid=28145): stderr: | 20221209104841600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104841600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104841600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104841600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104841600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104841600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104841612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104841620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104841620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104841620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:44.860752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28144): Terminating (SIGTERM) 10:48:44.902610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28147): Terminating (SIGTERM) 10:48:44.944680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28150): Terminating (SIGTERM) 10:48:44.987089 --- ParallelTerminationStrategy: PID 28144 died... 10:48:45.007197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28144): Terminated: ok {rc=0} 10:48:45.053513 --- ParallelTerminationStrategy: PID 28147 died... 10:48:45.073033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28147): Terminated: ok {rc=0} 10:48:45.119412 --- ParallelTerminationStrategy: PID 28150 died... 10:48:45.138853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28150): Terminated: ok {rc=0} 10:48:45.227023 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:48:46.564380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:46.572493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:48:46.606974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:48:46.655812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:48:46.762628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:48:46.806228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:48:46.854091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:48:47.420657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:48:47.470414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:47.481620 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:48:47.548041 tst cs_paging_gprs_active.py: using LAC 20940 10:48:47.677735 tst cs_paging_gprs_active.py: using RAC 30 10:48:47.797958 tst cs_paging_gprs_active.py: using CellId 20940 10:48:47.920193 tst cs_paging_gprs_active.py: using BVCI 20941 10:48:48.032399 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.043612 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.054661 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.066396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.078000 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.089589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.100890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.112186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:48:48.123546 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:48:48.243980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:48:48.361037 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:48:48.564166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:48.868595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28155): Launched 10:48:49.132011 run iperf3-srv_10.42.42.10(pid=28156): Launched 10:48:49.245939 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:48:49.447298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:49.750743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28157): Launched 10:48:50.014208 run iperf3-srv_10.42.42.10(pid=28158): Launched 10:48:50.128353 tst cs_paging_gprs_active.py:38: start network... 10:48:50.329729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:50.797809 run create_hlr_db(pid=28159): Launched 10:48:50.923813 bus /gobi_6: Setting Powered False 10:48:51.984567 run create_hlr_db(pid=28159): Terminated: ok {rc=0} 10:48:52.426485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28161): Launched 10:48:52.752377 run osmo-hlr_10.42.42.2(pid=28162): Launched 10:48:52.876655 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:53.431404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28164): Launched 10:48:53.754857 run osmo-stp_10.42.42.5(pid=28165): Launched 10:48:53.879507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:54.436856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28167): Launched 10:48:54.560559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:54.841768 run patchelf(pid=28168): Launched 10:48:55.010343 run osmo-stp_10.42.42.5(pid=28165): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28165)] 10:48:55.138447 run osmo-stp_10.42.42.5(pid=28165): stdout: | (launched: 2022-12-09_10:48:53.695794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:55.268128 run osmo-stp_10.42.42.5(pid=28165): stderr: | 20221209104853884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104853884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104853884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104853885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104853885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104853885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104853885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:55.397917 run osmo-stp_10.42.42.5(pid=28165): stdout: | (launched: 2022-12-09_10:48:53.695794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:55.522384 run osmo-stp_10.42.42.5(pid=28165): stderr: | 20221209104853884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104853884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104853884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104853885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104853885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104853885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104853885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:55.669843 run patchelf(pid=28168): Terminating (SIGINT) 10:48:55.838970 run patchelf(pid=28168): Terminated: ok {rc=0} 10:48:55.960896 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28165): Process ended prematurely: osmo-stp_10.42.42.5(pid=28165) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28165)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:48:55.970716 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:48:55.998277 run osmo-hlr_10.42.42.2(pid=28162): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28162)] 10:48:56.046345 run osmo-hlr_10.42.42.2(pid=28162): stdout: | (launched: 2022-12-09_10:48:52.692777) 10:48:56.096452 run osmo-hlr_10.42.42.2(pid=28162): stderr: | 20221209104852888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104852888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104852888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104852888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104852889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104852889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104852901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104852909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104852909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104852910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:56.146692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28155): Terminating (SIGTERM) 10:48:56.186726 run iperf3-srv_10.42.42.10(pid=28156): Terminating (SIGTERM) 10:48:56.226514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28157): Terminating (SIGTERM) 10:48:56.266375 run iperf3-srv_10.42.42.10(pid=28158): Terminating (SIGTERM) 10:48:56.306077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28161): Terminating (SIGTERM) 10:48:56.345953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28164): Terminating (SIGTERM) 10:48:56.385626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28167): Terminating (SIGTERM) 10:48:56.425663 --- ParallelTerminationStrategy: PID 28155 died... 10:48:56.444753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28155): Terminated: ok {rc=0} 10:48:56.488665 --- ParallelTerminationStrategy: PID 28156 died... 10:48:56.507197 run iperf3-srv_10.42.42.10(pid=28156): Terminated {rc=256} 10:48:56.551107 --- ParallelTerminationStrategy: PID 28157 died... 10:48:56.569548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28157): Terminated: ok {rc=0} 10:48:56.613191 --- ParallelTerminationStrategy: PID 28158 died... 10:48:56.631636 run iperf3-srv_10.42.42.10(pid=28158): Terminated {rc=256} 10:48:56.675593 --- ParallelTerminationStrategy: PID 28161 died... 10:48:56.694621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28161): Terminated: ok {rc=0} 10:48:56.738324 --- ParallelTerminationStrategy: PID 28164 died... 10:48:56.756830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28164): Terminated: ok {rc=0} 10:48:56.801176 --- ParallelTerminationStrategy: PID 28167 died... 10:48:56.819736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28167): Terminated: ok {rc=0} 10:48:56.903875 bus /gobi_0: Setting Powered False 10:48:58.001120 bus /gobi_0: Setting Powered False 10:48:59.119350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:49:00.265613 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.277228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:49:00.345136 tst iperf3.py: using LAC 20941 10:49:00.464547 tst iperf3.py: using RAC 31 10:49:00.581780 tst iperf3.py: using CellId 20941 10:49:00.710422 tst iperf3.py: using BVCI 20942 10:49:00.832406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.846008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.858099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.871976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.884858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.896896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.909930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.923219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:00.937145 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:01.069203 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:49:01.277597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:01.635169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28169): Launched 10:49:01.926226 run iperf3-srv_10.42.42.10(pid=28170): Launched 10:49:02.054352 tst iperf3.py:8: start network... 10:49:02.262074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:02.730167 run create_hlr_db(pid=28171): Launched 10:49:02.853688 bus /gobi_6: Setting Powered False 10:49:03.913475 run create_hlr_db(pid=28171): Terminated: ok {rc=0} 10:49:04.352474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28174): Launched 10:49:04.675645 run osmo-hlr_10.42.42.2(pid=28175): Launched 10:49:04.799507 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:05.367599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28177): Launched 10:49:05.690145 run osmo-stp_10.42.42.5(pid=28178): Launched 10:49:05.813450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:06.369379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28180): Launched 10:49:06.492723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:06.766673 run patchelf(pid=28181): Launched 10:49:06.947206 run osmo-stp_10.42.42.5(pid=28178): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28178)] 10:49:07.083253 run osmo-stp_10.42.42.5(pid=28178): stdout: | (launched: 2022-12-09_10:49:05.630990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:07.221092 run osmo-stp_10.42.42.5(pid=28178): stderr: | 20221209104905820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104905820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104905821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104905821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104905822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104905822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104905822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:07.359043 run osmo-stp_10.42.42.5(pid=28178): stdout: | (launched: 2022-12-09_10:49:05.630990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:07.491220 run osmo-stp_10.42.42.5(pid=28178): stderr: | 20221209104905820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104905820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104905821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104905821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104905822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104905822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104905822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:07.648528 run patchelf(pid=28181): Terminating (SIGINT) 10:49:07.829113 run patchelf(pid=28181): Terminated: ok {rc=0} 10:49:07.959263 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28178): Process ended prematurely: osmo-stp_10.42.42.5(pid=28178) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28178)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 10:49:07.969635 tst iperf3.py:8: Test FAILED (7.7 sec) 10:49:07.998810 run osmo-hlr_10.42.42.2(pid=28175): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28175)] 10:49:08.049490 run osmo-hlr_10.42.42.2(pid=28175): stdout: | (launched: 2022-12-09_10:49:04.616306) 10:49:08.101642 run osmo-hlr_10.42.42.2(pid=28175): stderr: | 20221209104904811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104904811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104904811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104904811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104904811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104904811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104904829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104904838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104904838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104904838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:08.154524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28169): Terminating (SIGTERM) 10:49:08.196927 run iperf3-srv_10.42.42.10(pid=28170): Terminating (SIGTERM) 10:49:08.239257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28174): Terminating (SIGTERM) 10:49:08.281974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28177): Terminating (SIGTERM) 10:49:08.324260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28180): Terminating (SIGTERM) 10:49:08.366700 --- ParallelTerminationStrategy: PID 28169 died... 10:49:08.386680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28169): Terminated: ok {rc=0} 10:49:08.433628 --- ParallelTerminationStrategy: PID 28170 died... 10:49:08.453195 run iperf3-srv_10.42.42.10(pid=28170): Terminated {rc=256} 10:49:08.500149 --- ParallelTerminationStrategy: PID 28174 died... 10:49:08.520130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28174): Terminated: ok {rc=0} 10:49:08.566989 --- ParallelTerminationStrategy: PID 28177 died... 10:49:08.586768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28177): Terminated: ok {rc=0} 10:49:08.633490 --- ParallelTerminationStrategy: PID 28180 died... 10:49:08.653170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28180): Terminated: ok {rc=0} 10:49:08.742003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:49:09.893062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:09.905147 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:49:09.972895 tst iperf3m4.py: using LAC 20942 10:49:10.099105 tst iperf3m4.py: using RAC 32 10:49:10.226965 tst iperf3m4.py: using CellId 20942 10:49:10.356414 tst iperf3m4.py: using BVCI 20943 10:49:10.474149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.485693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.497060 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.508602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.520216 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.531682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.543838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.555399 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:10.567560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:10.686734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:10.805391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:10.923992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:11.043882 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:49:11.259953 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:11.583530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28182): Launched 10:49:11.866835 run iperf3-srv_10.42.42.10(pid=28183): Launched 10:49:11.990715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:49:12.207614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:12.531382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28184): Launched 10:49:12.815048 run iperf3-srv_10.42.42.10(pid=28185): Launched 10:49:12.936854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:49:13.152573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:13.477524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28186): Launched 10:49:13.761230 run iperf3-srv_10.42.42.10(pid=28187): Launched 10:49:13.882541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:49:14.099198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:14.424716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28188): Launched 10:49:14.706292 run iperf3-srv_10.42.42.10(pid=28189): Launched 10:49:14.828078 tst iperf3m4.py:8: start network... 10:49:15.044454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:15.545540 run create_hlr_db(pid=28190): Launched 10:49:15.670803 bus /gobi_6: Setting Powered False 10:49:16.730874 run create_hlr_db(pid=28190): Terminated: ok {rc=0} 10:49:17.193164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Launched 10:49:17.527174 run osmo-hlr_10.42.42.2(pid=28193): Launched 10:49:17.653463 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:18.208005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Launched 10:49:18.531037 run osmo-stp_10.42.42.5(pid=28196): Launched 10:49:18.654793 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:19.211423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28198): Launched 10:49:19.334943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:19.607494 run patchelf(pid=28199): Launched 10:49:19.788227 run osmo-stp_10.42.42.5(pid=28196): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] 10:49:19.923801 run osmo-stp_10.42.42.5(pid=28196): stdout: | (launched: 2022-12-09_10:49:18.471838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:20.060529 run osmo-stp_10.42.42.5(pid=28196): stderr: | 20221209104918658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104918658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104918659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104918659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104918659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104918659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104918660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:20.197336 run osmo-stp_10.42.42.5(pid=28196): stdout: | (launched: 2022-12-09_10:49:18.471838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:20.329468 run osmo-stp_10.42.42.5(pid=28196): stderr: | 20221209104918658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104918658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104918659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104918659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104918659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104918659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104918660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:20.485895 run patchelf(pid=28199): Terminating (SIGINT) 10:49:20.665919 run patchelf(pid=28199): Terminated: ok {rc=0} 10:49:20.795320 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28196): Process ended prematurely: osmo-stp_10.42.42.5(pid=28196) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:49:20.805665 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:49:20.835138 run osmo-hlr_10.42.42.2(pid=28193): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28193)] 10:49:20.885368 run osmo-hlr_10.42.42.2(pid=28193): stdout: | (launched: 2022-12-09_10:49:17.467276) 10:49:20.937371 run osmo-hlr_10.42.42.2(pid=28193): stderr: | 20221209104917663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104917663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104917663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104917663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104917663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104917663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104917676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104917685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104917685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104917685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:20.989877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28182): Terminating (SIGTERM) 10:49:21.031836 run iperf3-srv_10.42.42.10(pid=28183): Terminating (SIGTERM) 10:49:21.073826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28184): Terminating (SIGTERM) 10:49:21.115813 run iperf3-srv_10.42.42.10(pid=28185): Terminating (SIGTERM) 10:49:21.157452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28186): Terminating (SIGTERM) 10:49:21.199318 run iperf3-srv_10.42.42.10(pid=28187): Terminating (SIGTERM) 10:49:21.240906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28188): Terminating (SIGTERM) 10:49:21.282872 run iperf3-srv_10.42.42.10(pid=28189): Terminating (SIGTERM) 10:49:21.324737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Terminating (SIGTERM) 10:49:21.366801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Terminating (SIGTERM) 10:49:21.408574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28198): Terminating (SIGTERM) 10:49:21.450701 --- ParallelTerminationStrategy: PID 28182 died... 10:49:21.470641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28182): Terminated: ok {rc=0} 10:49:21.517149 --- ParallelTerminationStrategy: PID 28183 died... 10:49:21.536557 run iperf3-srv_10.42.42.10(pid=28183): Terminated {rc=256} 10:49:21.583134 --- ParallelTerminationStrategy: PID 28184 died... 10:49:21.602588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28184): Terminated: ok {rc=0} 10:49:21.648797 --- ParallelTerminationStrategy: PID 28185 died... 10:49:21.668561 run iperf3-srv_10.42.42.10(pid=28185): Terminated {rc=256} 10:49:21.714718 --- ParallelTerminationStrategy: PID 28186 died... 10:49:21.734189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28186): Terminated: ok {rc=0} 10:49:21.780335 --- ParallelTerminationStrategy: PID 28187 died... 10:49:21.799711 run iperf3-srv_10.42.42.10(pid=28187): Terminated {rc=256} 10:49:21.846108 --- ParallelTerminationStrategy: PID 28188 died... 10:49:21.865576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28188): Terminated: ok {rc=0} 10:49:21.911790 --- ParallelTerminationStrategy: PID 28189 died... 10:49:21.931239 run iperf3-srv_10.42.42.10(pid=28189): Terminated {rc=256} 10:49:21.977480 --- ParallelTerminationStrategy: PID 28192 died... 10:49:21.996882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Terminated: ok {rc=0} 10:49:22.043341 --- ParallelTerminationStrategy: PID 28195 died... 10:49:22.062725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Terminated: ok {rc=0} 10:49:22.109227 --- ParallelTerminationStrategy: PID 28198 died... 10:49:22.128585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28198): Terminated: ok {rc=0} 10:49:22.217108 bus /gobi_4: Setting Powered False 10:49:23.316263 bus /gobi_4: Setting Powered False 10:49:24.433141 bus /gobi_1: Setting Powered False 10:49:25.531108 bus /gobi_1: Setting Powered False 10:49:26.647943 bus /gobi_0: Setting Powered False 10:49:27.745332 bus /gobi_0: Setting Powered False 10:49:28.863336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:49:29.962273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:29.973891 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:49:30.038793 tst ping.py: using LAC 20943 10:49:30.154146 tst ping.py: using RAC 33 10:49:30.271272 tst ping.py: using CellId 20943 10:49:30.390046 tst ping.py: using BVCI 20944 10:49:30.497548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.508466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.519213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.530113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.540740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.551522 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.562497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:30.573277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:30.689421 tst ping.py:19: start network... 10:49:30.914740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:31.435760 run create_hlr_db(pid=28200): Launched 10:49:31.598781 bus /gobi_6: Setting Powered False 10:49:32.657478 run create_hlr_db(pid=28200): Terminated: ok {rc=0} 10:49:33.102256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28202): Launched 10:49:33.418047 run osmo-hlr_10.42.42.2(pid=28203): Launched 10:49:33.540049 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:34.093744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28208): Launched 10:49:34.407891 run osmo-stp_10.42.42.5(pid=28209): Launched 10:49:34.529233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:35.076241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28211): Launched 10:49:35.198293 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:35.464406 run patchelf(pid=28212): Launched 10:49:35.642378 run osmo-stp_10.42.42.5(pid=28209): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28209)] 10:49:35.775790 run osmo-stp_10.42.42.5(pid=28209): stdout: | (launched: 2022-12-09_10:49:34.349828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:35.910538 run osmo-stp_10.42.42.5(pid=28209): stderr: | 20221209104934540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104934540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104934541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104934541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104934542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104934542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104934542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:36.045036 run osmo-stp_10.42.42.5(pid=28209): stdout: | (launched: 2022-12-09_10:49:34.349828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:36.174583 run osmo-stp_10.42.42.5(pid=28209): stderr: | 20221209104934540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104934540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104934541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104934541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104934542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104934542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104934542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:36.327923 run patchelf(pid=28212): Terminating (SIGINT) 10:49:36.504321 run patchelf(pid=28212): Terminated: ok {rc=0} 10:49:36.632138 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28209): Process ended prematurely: osmo-stp_10.42.42.5(pid=28209) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28209)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 10:49:36.641882 tst ping.py:22: Test FAILED (6.7 sec) 10:49:36.670677 run osmo-hlr_10.42.42.2(pid=28203): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28203)] 10:49:36.720810 run osmo-hlr_10.42.42.2(pid=28203): stdout: | (launched: 2022-12-09_10:49:33.359219) 10:49:36.772604 run osmo-hlr_10.42.42.2(pid=28203): stderr: | 20221209104933554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104933554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104933555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104933555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104933555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104933555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104933566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104933575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104933575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104933575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:36.824909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28202): Terminating (SIGTERM) 10:49:36.866861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28208): Terminating (SIGTERM) 10:49:36.908691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28211): Terminating (SIGTERM) 10:49:36.951297 --- ParallelTerminationStrategy: PID 28202 died... 10:49:36.971164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28202): Terminated: ok {rc=0} 10:49:37.017861 --- ParallelTerminationStrategy: PID 28208 died... 10:49:37.037319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28208): Terminated: ok {rc=0} 10:49:37.083564 --- ParallelTerminationStrategy: PID 28211 died... 10:49:37.103089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28211): Terminated: ok {rc=0} 10:49:37.191260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:49:38.278630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.291138 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:49:38.365194 tst ping_idle_ping.py: using LAC 20944 10:49:38.488503 tst ping_idle_ping.py: using RAC 34 10:49:38.611268 tst ping_idle_ping.py: using CellId 20944 10:49:38.733988 tst ping_idle_ping.py: using BVCI 20945 10:49:38.850585 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.862116 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.873393 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.884861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.896183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.907566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.918927 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:49:38.930368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:49:39.049058 tst ping_idle_ping.py:24: start network... 10:49:39.260712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:39.753126 run create_hlr_db(pid=28213): Launched 10:49:39.875018 bus /gobi_6: Setting Powered False 10:49:40.937902 run create_hlr_db(pid=28213): Terminated: ok {rc=0} 10:49:41.379277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28215): Launched 10:49:41.697006 run osmo-hlr_10.42.42.2(pid=28216): Launched 10:49:41.818313 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:42.366993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28218): Launched 10:49:42.686564 run osmo-stp_10.42.42.5(pid=28219): Launched 10:49:42.808345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:43.355330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28221): Launched 10:49:43.477800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:43.746219 run patchelf(pid=28222): Launched 10:49:43.924224 run osmo-stp_10.42.42.5(pid=28219): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28219)] 10:49:44.058812 run osmo-stp_10.42.42.5(pid=28219): stdout: | (launched: 2022-12-09_10:49:42.627135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:44.194608 run osmo-stp_10.42.42.5(pid=28219): stderr: | 20221209104942815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104942815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104942816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104942816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104942816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104942817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104942817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:44.330558 run osmo-stp_10.42.42.5(pid=28219): stdout: | (launched: 2022-12-09_10:49:42.627135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:44.461172 run osmo-stp_10.42.42.5(pid=28219): stderr: | 20221209104942815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104942815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104942816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104942816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104942816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104942817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104942817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:44.615876 run patchelf(pid=28222): Terminating (SIGINT) 10:49:44.794000 run patchelf(pid=28222): Terminated: ok {rc=0} 10:49:44.922211 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28219): Process ended prematurely: osmo-stp_10.42.42.5(pid=28219) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28219)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:49:44.931830 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:49:44.960604 run osmo-hlr_10.42.42.2(pid=28216): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28216)] 10:49:45.010982 run osmo-hlr_10.42.42.2(pid=28216): stdout: | (launched: 2022-12-09_10:49:41.638253) 10:49:45.062851 run osmo-hlr_10.42.42.2(pid=28216): stderr: | 20221209104941833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104941833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104941833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104941833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104941833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104941833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104941845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104941853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104941853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104941853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:45.115947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28215): Terminating (SIGTERM) 10:49:45.157982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28218): Terminating (SIGTERM) 10:49:45.199869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28221): Terminating (SIGTERM) 10:49:45.242211 --- ParallelTerminationStrategy: PID 28215 died... 10:49:45.262196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28215): Terminated: ok {rc=0} 10:49:45.308905 --- ParallelTerminationStrategy: PID 28218 died... 10:49:45.328627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28218): Terminated: ok {rc=0} 10:49:45.375112 --- ParallelTerminationStrategy: PID 28221 died... 10:49:45.394677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28221): Terminated: ok {rc=0} 10:49:45.483482 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:49:46.783023 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:46.794258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:49:46.834363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:49:46.876222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:49:46.978880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:49:47.013563 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:49:47.056153 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:49:47.646966 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:49:47.700246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:47.711828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:49:47.778949 tst cs_paging_gprs_active.py: using LAC 20945 10:49:47.904614 tst cs_paging_gprs_active.py: using RAC 35 10:49:48.030300 tst cs_paging_gprs_active.py: using CellId 20945 10:49:48.157835 tst cs_paging_gprs_active.py: using BVCI 20946 10:49:48.277135 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.288600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.299898 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.311440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.322886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.334500 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.346243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.357588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:49:48.369197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:49:48.485873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:49:48.605140 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:49:48.807844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:49.111005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28226): Launched 10:49:49.373660 run iperf3-srv_10.42.42.10(pid=28227): Launched 10:49:49.487963 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:49:49.690540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:49.995901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28228): Launched 10:49:50.259726 run iperf3-srv_10.42.42.10(pid=28229): Launched 10:49:50.373080 tst cs_paging_gprs_active.py:38: start network... 10:49:50.574352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:51.042259 run create_hlr_db(pid=28230): Launched 10:49:51.169819 bus /gobi_6: Setting Powered False 10:49:52.230331 run create_hlr_db(pid=28230): Terminated: ok {rc=0} 10:49:52.674162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28232): Launched 10:49:52.998457 run osmo-hlr_10.42.42.2(pid=28233): Launched 10:49:53.123223 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:53.684603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28235): Launched 10:49:54.007145 run osmo-stp_10.42.42.5(pid=28236): Launched 10:49:54.131318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:54.688667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28238): Launched 10:49:54.812279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:55.092718 run patchelf(pid=28239): Launched 10:49:55.275081 run osmo-stp_10.42.42.5(pid=28236): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28236)] 10:49:55.411987 run osmo-stp_10.42.42.5(pid=28236): stdout: | (launched: 2022-12-09_10:49:53.947816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:55.550338 run osmo-stp_10.42.42.5(pid=28236): stderr: | 20221209104954137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104954137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104954137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104954137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104954138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104954138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104954138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:55.689410 run osmo-stp_10.42.42.5(pid=28236): stdout: | (launched: 2022-12-09_10:49:53.947816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:55.822205 run osmo-stp_10.42.42.5(pid=28236): stderr: | 20221209104954137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209104954137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209104954137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209104954137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209104954138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209104954138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209104954138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:55.980028 run patchelf(pid=28239): Terminating (SIGINT) 10:49:56.162043 run patchelf(pid=28239): Terminated: ok {rc=0} 10:49:56.293156 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28236): Process ended prematurely: osmo-stp_10.42.42.5(pid=28236) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28236)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:49:56.303540 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:49:56.333139 run osmo-hlr_10.42.42.2(pid=28233): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28233)] 10:49:56.383645 run osmo-hlr_10.42.42.2(pid=28233): stdout: | (launched: 2022-12-09_10:49:52.938844) 10:49:56.436003 run osmo-hlr_10.42.42.2(pid=28233): stderr: | 20221209104953135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209104953135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209104953135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209104953135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209104953135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209104953135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209104953148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209104953156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209104953156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209104953156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:56.489049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28226): Terminating (SIGTERM) 10:49:56.531021 run iperf3-srv_10.42.42.10(pid=28227): Terminating (SIGTERM) 10:49:56.573748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28228): Terminating (SIGTERM) 10:49:56.616178 run iperf3-srv_10.42.42.10(pid=28229): Terminating (SIGTERM) 10:49:56.658641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28232): Terminating (SIGTERM) 10:49:56.700883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28235): Terminating (SIGTERM) 10:49:56.743352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28238): Terminating (SIGTERM) 10:49:56.785871 --- ParallelTerminationStrategy: PID 28226 died... 10:49:56.805839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28226): Terminated: ok {rc=0} 10:49:56.852225 --- ParallelTerminationStrategy: PID 28227 died... 10:49:56.871664 run iperf3-srv_10.42.42.10(pid=28227): Terminated {rc=256} 10:49:56.918935 --- ParallelTerminationStrategy: PID 28228 died... 10:49:56.938480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28228): Terminated: ok {rc=0} 10:49:56.984861 --- ParallelTerminationStrategy: PID 28229 died... 10:49:57.004740 run iperf3-srv_10.42.42.10(pid=28229): Terminated {rc=256} 10:49:57.051140 --- ParallelTerminationStrategy: PID 28232 died... 10:49:57.070803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28232): Terminated: ok {rc=0} 10:49:57.117729 --- ParallelTerminationStrategy: PID 28235 died... 10:49:57.137357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28235): Terminated: ok {rc=0} 10:49:57.183837 --- ParallelTerminationStrategy: PID 28238 died... 10:49:57.203367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28238): Terminated: ok {rc=0} 10:49:57.291813 bus /gobi_0: Setting Powered False 10:49:58.391509 bus /gobi_0: Setting Powered False 10:49:59.508560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:50:00.651680 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:00.663505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:50:00.729593 tst iperf3.py: using LAC 20946 10:50:00.856205 tst iperf3.py: using RAC 36 10:50:01.011214 tst iperf3.py: using CellId 20946 10:50:01.142433 tst iperf3.py: using BVCI 20947 10:50:01.293147 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.304816 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.316499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.328355 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.340176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.351862 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.363687 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.375381 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:01.387429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:01.531179 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:50:01.749443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:02.066888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28243): Launched 10:50:02.346930 run iperf3-srv_10.42.42.10(pid=28244): Launched 10:50:02.460368 tst iperf3.py:8: start network... 10:50:02.660472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:03.127445 run create_hlr_db(pid=28245): Launched 10:50:03.252017 bus /gobi_6: Setting Powered False 10:50:04.311610 run create_hlr_db(pid=28245): Terminated: ok {rc=0} 10:50:04.755026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28247): Launched 10:50:05.079513 run osmo-hlr_10.42.42.2(pid=28248): Launched 10:50:05.203323 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:05.762205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28250): Launched 10:50:06.087804 run osmo-stp_10.42.42.5(pid=28251): Launched 10:50:06.211946 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:06.770629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28253): Launched 10:50:06.895172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:07.168657 run patchelf(pid=28254): Launched 10:50:07.349860 run osmo-stp_10.42.42.5(pid=28251): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28251)] 10:50:07.486314 run osmo-stp_10.42.42.5(pid=28251): stdout: | (launched: 2022-12-09_10:50:06.027065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:07.624901 run osmo-stp_10.42.42.5(pid=28251): stderr: | 20221209105006215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105006215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105006215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105006216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105006216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105006216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105006216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:07.763254 run osmo-stp_10.42.42.5(pid=28251): stdout: | (launched: 2022-12-09_10:50:06.027065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:07.895596 run osmo-stp_10.42.42.5(pid=28251): stderr: | 20221209105006215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105006215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105006215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105006216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105006216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105006216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105006216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:08.052435 run patchelf(pid=28254): Terminating (SIGINT) 10:50:08.233667 run patchelf(pid=28254): Terminated: ok {rc=0} 10:50:08.363891 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28251): Process ended prematurely: osmo-stp_10.42.42.5(pid=28251) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28251)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 10:50:08.374224 tst iperf3.py:8: Test FAILED (7.8 sec) 10:50:08.403495 run osmo-hlr_10.42.42.2(pid=28248): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28248)] 10:50:08.453958 run osmo-hlr_10.42.42.2(pid=28248): stdout: | (launched: 2022-12-09_10:50:05.019758) 10:50:08.506353 run osmo-hlr_10.42.42.2(pid=28248): stderr: | 20221209105005213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105005213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105005213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105005213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105005213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105005213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105005228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105005238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105005238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105005238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:08.559189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28243): Terminating (SIGTERM) 10:50:08.601775 run iperf3-srv_10.42.42.10(pid=28244): Terminating (SIGTERM) 10:50:08.644097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28247): Terminating (SIGTERM) 10:50:08.686794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28250): Terminating (SIGTERM) 10:50:08.729080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28253): Terminating (SIGTERM) 10:50:08.771697 --- ParallelTerminationStrategy: PID 28243 died... 10:50:08.791700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28243): Terminated: ok {rc=0} 10:50:08.838578 --- ParallelTerminationStrategy: PID 28244 died... 10:50:08.858081 run iperf3-srv_10.42.42.10(pid=28244): Terminated {rc=256} 10:50:08.904523 --- ParallelTerminationStrategy: PID 28247 died... 10:50:08.924019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28247): Terminated: ok {rc=0} 10:50:08.970816 --- ParallelTerminationStrategy: PID 28250 died... 10:50:08.990355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28250): Terminated: ok {rc=0} 10:50:09.036738 --- ParallelTerminationStrategy: PID 28253 died... 10:50:09.056303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28253): Terminated: ok {rc=0} 10:50:09.144615 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:50:10.292440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.304350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:50:10.369511 tst iperf3m4.py: using LAC 20947 10:50:10.487573 tst iperf3m4.py: using RAC 37 10:50:10.615276 tst iperf3m4.py: using CellId 20947 10:50:10.741443 tst iperf3m4.py: using BVCI 20948 10:50:10.851449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.862786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.873916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.885231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.896418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.907613 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.918887 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.929914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:10.941265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:11.057872 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:11.174730 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:11.292183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:11.407466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:50:11.609331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:11.912484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28255): Launched 10:50:12.175714 run iperf3-srv_10.42.42.10(pid=28256): Launched 10:50:12.290390 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:50:12.492224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:12.797764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Launched 10:50:13.062593 run iperf3-srv_10.42.42.10(pid=28258): Launched 10:50:13.177856 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:50:13.377519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:13.680534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28259): Launched 10:50:13.943537 run iperf3-srv_10.42.42.10(pid=28260): Launched 10:50:14.056179 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:50:14.256031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:14.559018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28261): Launched 10:50:14.823057 run iperf3-srv_10.42.42.10(pid=28262): Launched 10:50:14.936575 tst iperf3m4.py:8: start network... 10:50:15.137050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:15.606683 run create_hlr_db(pid=28263): Launched 10:50:15.732609 bus /gobi_6: Setting Powered False 10:50:16.796843 run create_hlr_db(pid=28263): Terminated: ok {rc=0} 10:50:17.269378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28265): Launched 10:50:17.572372 run osmo-hlr_10.42.42.2(pid=28266): Launched 10:50:17.687061 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:18.206338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28268): Launched 10:50:18.510330 run osmo-stp_10.42.42.5(pid=28269): Launched 10:50:18.627195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:19.150359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28271): Launched 10:50:19.265229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:19.519654 run patchelf(pid=28272): Launched 10:50:19.687620 run osmo-stp_10.42.42.5(pid=28269): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28269)] 10:50:19.814424 run osmo-stp_10.42.42.5(pid=28269): stdout: | (launched: 2022-12-09_10:50:18.454044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:19.942672 run osmo-stp_10.42.42.5(pid=28269): stderr: | 20221209105018622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105018622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105018622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105018623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105018623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105018623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105018623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:20.071052 run osmo-stp_10.42.42.5(pid=28269): stdout: | (launched: 2022-12-09_10:50:18.454044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:20.193989 run osmo-stp_10.42.42.5(pid=28269): stderr: | 20221209105018622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105018622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105018622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105018623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105018623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105018623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105018623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:20.339943 run patchelf(pid=28272): Terminating (SIGINT) 10:50:20.508052 run patchelf(pid=28272): Terminated: ok {rc=0} 10:50:20.631005 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28269): Process ended prematurely: osmo-stp_10.42.42.5(pid=28269) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28269)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:50:20.640509 tst iperf3m4.py:8: Test FAILED (10.4 sec) 10:50:20.667974 run osmo-hlr_10.42.42.2(pid=28266): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28266)] 10:50:20.715348 run osmo-hlr_10.42.42.2(pid=28266): stdout: | (launched: 2022-12-09_10:50:17.515877) 10:50:20.765589 run osmo-hlr_10.42.42.2(pid=28266): stderr: | 20221209105017690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105017690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105017690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105017690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105017690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105017690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105017705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105017715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105017715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105017715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:20.815578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28255): Terminating (SIGTERM) 10:50:20.855327 run iperf3-srv_10.42.42.10(pid=28256): Terminating (SIGTERM) 10:50:20.895047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Terminating (SIGTERM) 10:50:20.934665 run iperf3-srv_10.42.42.10(pid=28258): Terminating (SIGTERM) 10:50:20.974130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28259): Terminating (SIGTERM) 10:50:21.013708 run iperf3-srv_10.42.42.10(pid=28260): Terminating (SIGTERM) 10:50:21.053183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28261): Terminating (SIGTERM) 10:50:21.092756 run iperf3-srv_10.42.42.10(pid=28262): Terminating (SIGTERM) 10:50:21.132384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28265): Terminating (SIGTERM) 10:50:21.172166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28268): Terminating (SIGTERM) 10:50:21.211986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28271): Terminating (SIGTERM) 10:50:21.251853 --- ParallelTerminationStrategy: PID 28255 died... 10:50:21.271185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28255): Terminated: ok {rc=0} 10:50:21.315267 --- ParallelTerminationStrategy: PID 28256 died... 10:50:21.334008 run iperf3-srv_10.42.42.10(pid=28256): Terminated {rc=256} 10:50:21.377710 --- ParallelTerminationStrategy: PID 28257 died... 10:50:21.396371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Terminated: ok {rc=0} 10:50:21.439890 --- ParallelTerminationStrategy: PID 28258 died... 10:50:21.458507 run iperf3-srv_10.42.42.10(pid=28258): Terminated {rc=256} 10:50:21.502182 --- ParallelTerminationStrategy: PID 28259 died... 10:50:21.520820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28259): Terminated: ok {rc=0} 10:50:21.564633 --- ParallelTerminationStrategy: PID 28260 died... 10:50:21.583406 run iperf3-srv_10.42.42.10(pid=28260): Terminated {rc=256} 10:50:21.627094 --- ParallelTerminationStrategy: PID 28261 died... 10:50:21.645975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28261): Terminated: ok {rc=0} 10:50:21.689806 --- ParallelTerminationStrategy: PID 28262 died... 10:50:21.708358 run iperf3-srv_10.42.42.10(pid=28262): Terminated {rc=256} 10:50:21.751912 --- ParallelTerminationStrategy: PID 28265 died... 10:50:21.770664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28265): Terminated: ok {rc=0} 10:50:21.814616 --- ParallelTerminationStrategy: PID 28268 died... 10:50:21.833418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28268): Terminated: ok {rc=0} 10:50:21.877259 --- ParallelTerminationStrategy: PID 28271 died... 10:50:21.896106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28271): Terminated: ok {rc=0} 10:50:21.981827 bus /gobi_4: Setting Powered False 10:50:23.084476 bus /gobi_4: Setting Powered False 10:50:24.200206 bus /gobi_1: Setting Powered False 10:50:25.300124 bus /gobi_1: Setting Powered False 10:50:26.415773 bus /gobi_0: Setting Powered False 10:50:27.517365 bus /gobi_0: Setting Powered False 10:50:28.630180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:50:29.733169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:29.745617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:50:29.814929 tst ping.py: using LAC 20948 10:50:29.943367 tst ping.py: using RAC 38 10:50:30.065892 tst ping.py: using CellId 20948 10:50:30.188062 tst ping.py: using BVCI 20949 10:50:30.303375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.315145 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.326664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.338419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.350251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.362062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.373754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:30.385315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:30.502674 tst ping.py:19: start network... 10:50:30.714089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:31.215991 run create_hlr_db(pid=28273): Launched 10:50:31.375860 bus /gobi_6: Setting Powered False 10:50:32.435971 run create_hlr_db(pid=28273): Terminated: ok {rc=0} 10:50:32.851307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28275): Launched 10:50:33.146256 run osmo-hlr_10.42.42.2(pid=28276): Launched 10:50:33.258114 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:33.771594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28278): Launched 10:50:34.068770 run osmo-stp_10.42.42.5(pid=28279): Launched 10:50:34.180717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:34.690357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28281): Launched 10:50:34.802737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:35.052794 run patchelf(pid=28282): Launched 10:50:35.217788 run osmo-stp_10.42.42.5(pid=28279): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28279)] 10:50:35.343186 run osmo-stp_10.42.42.5(pid=28279): stdout: | (launched: 2022-12-09_10:50:34.012880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:35.469327 run osmo-stp_10.42.42.5(pid=28279): stderr: | 20221209105034181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105034182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105034182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105034182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105034183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105034183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105034183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:35.595755 run osmo-stp_10.42.42.5(pid=28279): stdout: | (launched: 2022-12-09_10:50:34.012880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:35.716449 run osmo-stp_10.42.42.5(pid=28279): stderr: | 20221209105034181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105034182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105034182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105034182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105034183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105034183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105034183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:35.860022 run patchelf(pid=28282): Terminating (SIGINT) 10:50:36.026052 run patchelf(pid=28282): Terminated: ok {rc=0} 10:50:36.145210 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28279): Process ended prematurely: osmo-stp_10.42.42.5(pid=28279) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28279)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 10:50:36.154154 tst ping.py:22: Test FAILED (6.4 sec) 10:50:36.181224 run osmo-hlr_10.42.42.2(pid=28276): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28276)] 10:50:36.229363 run osmo-hlr_10.42.42.2(pid=28276): stdout: | (launched: 2022-12-09_10:50:33.091285) 10:50:36.279067 run osmo-hlr_10.42.42.2(pid=28276): stderr: | 20221209105033260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105033260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105033260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105033260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105033260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105033260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105033273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105033283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105033283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105033283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:36.329292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28275): Terminating (SIGTERM) 10:50:36.369484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28278): Terminating (SIGTERM) 10:50:36.409757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28281): Terminating (SIGTERM) 10:50:36.450311 --- ParallelTerminationStrategy: PID 28275 died... 10:50:36.469667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28275): Terminated: ok {rc=0} 10:50:36.514190 --- ParallelTerminationStrategy: PID 28278 died... 10:50:36.533134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28278): Terminated: ok {rc=0} 10:50:36.577224 --- ParallelTerminationStrategy: PID 28281 died... 10:50:36.596020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28281): Terminated: ok {rc=0} 10:50:36.679461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:50:37.766958 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:37.779813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:50:37.851430 tst ping_idle_ping.py: using LAC 20949 10:50:37.978802 tst ping_idle_ping.py: using RAC 39 10:50:38.105921 tst ping_idle_ping.py: using CellId 20949 10:50:38.225094 tst ping_idle_ping.py: using BVCI 20950 10:50:38.342487 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.354321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.365867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.378800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.390396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.402653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.415113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:50:38.427543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:50:38.545769 tst ping_idle_ping.py:24: start network... 10:50:38.742993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:39.206715 run create_hlr_db(pid=28283): Launched 10:50:39.331637 bus /gobi_6: Setting Powered False 10:50:40.391094 run create_hlr_db(pid=28283): Terminated: ok {rc=0} 10:50:40.806144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28285): Launched 10:50:41.105248 run osmo-hlr_10.42.42.2(pid=28286): Launched 10:50:41.217924 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:41.729821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28288): Launched 10:50:42.027689 run osmo-stp_10.42.42.5(pid=28289): Launched 10:50:42.140089 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:42.649197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28291): Launched 10:50:42.761943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:43.012843 run patchelf(pid=28292): Launched 10:50:43.177961 run osmo-stp_10.42.42.5(pid=28289): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28289)] 10:50:43.303889 run osmo-stp_10.42.42.5(pid=28289): stdout: | (launched: 2022-12-09_10:50:41.971357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:43.430457 run osmo-stp_10.42.42.5(pid=28289): stderr: | 20221209105042138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105042138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105042138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105042138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105042139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105042139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105042139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:43.557204 run osmo-stp_10.42.42.5(pid=28289): stdout: | (launched: 2022-12-09_10:50:41.971357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:43.678674 run osmo-stp_10.42.42.5(pid=28289): stderr: | 20221209105042138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105042138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105042138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105042138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105042139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105042139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105042139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:43.822537 run patchelf(pid=28292): Terminating (SIGINT) 10:50:43.988420 run patchelf(pid=28292): Terminated: ok {rc=0} 10:50:44.108082 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28289): Process ended prematurely: osmo-stp_10.42.42.5(pid=28289) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28289)] [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:50:44.117106 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:50:44.144245 run osmo-hlr_10.42.42.2(pid=28286): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28286)] 10:50:44.192341 run osmo-hlr_10.42.42.2(pid=28286): stdout: | (launched: 2022-12-09_10:50:41.049187) 10:50:44.242169 run osmo-hlr_10.42.42.2(pid=28286): stderr: | 20221209105041222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105041222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105041222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105041222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105041222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105041223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105041235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105041243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105041244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105041244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:44.292474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28285): Terminating (SIGTERM) 10:50:44.332452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28288): Terminating (SIGTERM) 10:50:44.372322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28291): Terminating (SIGTERM) 10:50:44.412268 --- ParallelTerminationStrategy: PID 28285 died... 10:50:44.431604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28285): Terminated: ok {rc=0} 10:50:44.475786 --- ParallelTerminationStrategy: PID 28288 died... 10:50:44.494582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28288): Terminated: ok {rc=0} 10:50:44.538663 --- ParallelTerminationStrategy: PID 28291 died... 10:50:44.557556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28291): Terminated: ok {rc=0} 10:50:44.643965 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:50:45.978775 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:45.991038 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:50:46.024676 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:50:46.061403 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:50:46.120765 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:50:46.176006 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:50:46.227230 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:50:46.762051 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:50:46.770776 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:46.786124 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:50:46.864797 tst switch_tch_pdch.py: using LAC 20950 10:50:47.018483 tst switch_tch_pdch.py: using RAC 40 10:50:47.144939 tst switch_tch_pdch.py: using CellId 20950 10:50:47.292452 tst switch_tch_pdch.py: using BVCI 20951 10:50:47.410836 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.422772 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.434711 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.449252 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.460930 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.472406 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.483651 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:47.494685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:47.613886 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:47.730124 tst switch_tch_pdch.py:51: start network... 10:50:47.926447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:48.383813 run create_hlr_db(pid=28296): Launched 10:50:48.506088 bus /gobi_6: Setting Powered False 10:50:49.565830 run create_hlr_db(pid=28296): Terminated: ok {rc=0} 10:50:49.979483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28298): Launched 10:50:50.277140 run osmo-hlr_10.42.42.2(pid=28299): Launched 10:50:50.389644 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:50.916205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28301): Launched 10:50:51.212539 run osmo-stp_10.42.42.5(pid=28302): Launched 10:50:51.325786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:51.844660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28304): Launched 10:50:51.957642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:52.205752 run patchelf(pid=28305): Launched 10:50:52.369819 run osmo-stp_10.42.42.5(pid=28302): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28302)] 10:50:52.494820 run osmo-stp_10.42.42.5(pid=28302): stdout: | (launched: 2022-12-09_10:50:51.157542) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:52.620813 run osmo-stp_10.42.42.5(pid=28302): stderr: | 20221209105051327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105051328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105051328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105051328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105051329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105051329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105051329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:52.746867 run osmo-stp_10.42.42.5(pid=28302): stdout: | (launched: 2022-12-09_10:50:51.157542) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:52.867507 run osmo-stp_10.42.42.5(pid=28302): stderr: | 20221209105051327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105051328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105051328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105051328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105051329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105051329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105051329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:53.010977 run patchelf(pid=28305): Terminating (SIGINT) 10:50:53.176128 run patchelf(pid=28305): Terminated: ok {rc=0} 10:50:53.295125 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28302): Process ended prematurely: osmo-stp_10.42.42.5(pid=28302) [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28302)] [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:50:53.304050 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 10:50:53.331028 run osmo-hlr_10.42.42.2(pid=28299): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28299)] 10:50:53.378515 run osmo-hlr_10.42.42.2(pid=28299): stdout: | (launched: 2022-12-09_10:50:50.222133) 10:50:53.428242 run osmo-hlr_10.42.42.2(pid=28299): stderr: | 20221209105050395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105050395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105050395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105050395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105050395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105050395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105050407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105050416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105050416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105050416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:53.478390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28298): Terminating (SIGTERM) 10:50:53.518034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28301): Terminating (SIGTERM) 10:50:53.557591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28304): Terminating (SIGTERM) 10:50:53.597383 --- ParallelTerminationStrategy: PID 28298 died... 10:50:53.615869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28298): Terminated: ok {rc=0} 10:50:53.659785 --- ParallelTerminationStrategy: PID 28301 died... 10:50:53.678409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28301): Terminated: ok {rc=0} 10:50:53.722011 --- ParallelTerminationStrategy: PID 28304 died... 10:50:53.740586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28304): Terminated: ok {rc=0} 10:50:53.827080 bus /gobi_0: Setting Powered False 10:50:54.928046 bus /gobi_0: Setting Powered False 10:50:56.043657 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:50:57.298872 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:57.304561 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:50:57.333085 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:50:57.366789 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:50:57.419352 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:50:57.447714 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:50:57.481267 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:50:58.038710 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:50:58.043619 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.054705 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:50:58.123913 tst switch_tch_pdch.py: using LAC 20951 10:50:58.239069 tst switch_tch_pdch.py: using RAC 41 10:50:58.353181 tst switch_tch_pdch.py: using CellId 20951 10:50:58.467550 tst switch_tch_pdch.py: using BVCI 20952 10:50:58.574210 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.585317 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.596097 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.606990 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.617764 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.628612 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.639637 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:58.650497 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:50:58.768415 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:50:58.883367 tst switch_tch_pdch.py:51: start network... 10:50:59.080717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:59.513428 run create_hlr_db(pid=28311): Launched 10:50:59.635336 bus /gobi_6: Setting Powered False 10:51:00.694802 run create_hlr_db(pid=28311): Terminated: ok {rc=0} 10:51:01.123628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28313): Launched 10:51:01.461763 run osmo-hlr_10.42.42.2(pid=28314): Launched 10:51:01.637806 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:02.253513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28316): Launched 10:51:02.550043 run osmo-stp_10.42.42.5(pid=28317): Launched 10:51:02.661920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:03.147616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28319): Launched 10:51:03.260327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:03.508719 run patchelf(pid=28321): Launched 10:51:03.673254 run osmo-stp_10.42.42.5(pid=28317): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28317)] 10:51:03.798077 run osmo-stp_10.42.42.5(pid=28317): stdout: | (launched: 2022-12-09_10:51:02.494685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:03.924270 run osmo-stp_10.42.42.5(pid=28317): stderr: | 20221209105102663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105102664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105102664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105102664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105102665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105102665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105102665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:04.050412 run osmo-stp_10.42.42.5(pid=28317): stdout: | (launched: 2022-12-09_10:51:02.494685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:04.171422 run osmo-stp_10.42.42.5(pid=28317): stderr: | 20221209105102663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105102664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105102664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105102664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105102665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105102665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105102665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:04.314535 run patchelf(pid=28321): Terminating (SIGINT) 10:51:04.479694 run patchelf(pid=28321): Terminated: ok {rc=0} 10:51:04.598840 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28317): Process ended prematurely: osmo-stp_10.42.42.5(pid=28317) [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28317)] [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:51:04.607779 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:51:04.634647 run osmo-hlr_10.42.42.2(pid=28314): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28314)] 10:51:04.681912 run osmo-hlr_10.42.42.2(pid=28314): stdout: | (launched: 2022-12-09_10:51:01.391805) 10:51:04.731029 run osmo-hlr_10.42.42.2(pid=28314): stderr: | 20221209105101746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105101746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105101746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105101746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105101746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105101746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105101762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105101770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105101770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105101770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:04.780434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28313): Terminating (SIGTERM) 10:51:04.820017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28316): Terminating (SIGTERM) 10:51:04.859513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28319): Terminating (SIGTERM) 10:51:04.899333 --- ParallelTerminationStrategy: PID 28313 died... 10:51:04.918322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28313): Terminated: ok {rc=0} 10:51:04.961929 --- ParallelTerminationStrategy: PID 28316 died... 10:51:04.980389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28316): Terminated: ok {rc=0} 10:51:05.023822 --- ParallelTerminationStrategy: PID 28319 died... 10:51:05.042366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28319): Terminated: ok {rc=0} 10:51:05.128063 bus /gobi_0: Setting Powered False 10:51:06.227936 bus /gobi_0: Setting Powered False 10:51:07.343328 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_sms:nanobts --------------------------------------------------------------------- 10:51:08.589118 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:08.593073 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 10:51:08.616615 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 10:51:08.623298 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 10:51:08.675369 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 10:51:08.699030 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 10:51:08.705622 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 10:51:09.241141 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 10:51:09.245993 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 10:51:09.256458 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 10:51:09.293422 tst mo_mt_sms.py: using LAC 20952 10:51:09.411644 tst mo_mt_sms.py: using RAC 42 10:51:09.538842 tst mo_mt_sms.py: using CellId 20952 10:51:09.665146 tst mo_mt_sms.py: using BVCI 20953 10:51:09.781047 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 10:51:09.895064 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 10:51:10.011147 tst mo_mt_sms.py:9: start nitb and bts... 10:51:10.223430 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:51:10.872689 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28325): Launched 10:51:11.190210 run osmo-nitb_10.42.42.2(pid=28326): Launched 10:51:11.365987 run osmo-nitb_10.42.42.2(pid=28326): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28326)] 10:51:11.508455 run osmo-nitb_10.42.42.2(pid=28326): stdout: | (launched: 2022-12-09_10:51:11.131694) 10:51:11.653276 run osmo-nitb_10.42.42.2(pid=28326): stderr: | (launched: 2022-12-09_10:51:11.179006) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:51:11.797084 run osmo-nitb_10.42.42.2(pid=28326): stdout: | (launched: 2022-12-09_10:51:11.131694) 10:51:11.935865 run osmo-nitb_10.42.42.2(pid=28326): stderr: | (launched: 2022-12-09_10:51:11.179006) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28326) [trial-2358↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28326)] 10:51:12.309420 tst osmo-nitb_10.42.42.2(pid=28326): stdout: | (launched: 2022-12-09_10:51:11.131694) 10:51:12.436864 tst osmo-nitb_10.42.42.2(pid=28326): stderr: | (launched: 2022-12-09_10:51:11.179006) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:51:12.587722 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28326) [trial-2358↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28326)] [trial-2358↪nitb_sms:nanobts↪mo_mt_sms.py:11] 10:51:12.597482 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:51:12.604856 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28325): Terminating (SIGTERM) 10:51:12.816504 --- ParallelTerminationStrategy: PID 28325 died... 10:51:12.839644 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28325): Terminated: ok {rc=0} 10:51:12.928117 bus /sierra_3: Setting Powered False 10:51:14.027870 bus /sierra_3: Setting Powered False 10:51:15.146001 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:nanobts+band-1900 --------------------------------------------------------------------- 10:51:16.330956 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:16.338529 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:51:16.371539 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:51:16.399067 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 10:51:16.451226 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:51:16.479239 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:51:16.516872 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 10:51:17.057178 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 10:51:17.065150 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:17.080350 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:17.126523 tst mo_mt_sms.py: using LAC 20953 10:51:17.254875 tst mo_mt_sms.py: using RAC 43 10:51:17.369525 tst mo_mt_sms.py: using CellId 20953 10:51:17.495251 tst mo_mt_sms.py: using BVCI 20954 10:51:17.603901 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:17.614758 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:17.625535 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:17.636478 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:17.647084 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:17.657528 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 10:51:17.774952 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 10:51:17.890091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:18.350284 run create_hlr_db(pid=28330): Launched 10:51:18.472649 bus /sierra_2: Setting Powered False 10:51:19.531917 run create_hlr_db(pid=28330): Terminated: ok {rc=0} 10:51:19.965430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28332): Launched 10:51:20.284717 run osmo-hlr_10.42.42.2(pid=28333): Launched 10:51:20.407272 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:20.953742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28335): Launched 10:51:21.273291 run osmo-stp_10.42.42.5(pid=28336): Launched 10:51:21.396052 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:21.991363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28338): Launched 10:51:22.288350 run osmo-msc_10.42.42.6(pid=28339): Launched 10:51:22.452717 run osmo-stp_10.42.42.5(pid=28336): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28336)] 10:51:22.577112 run osmo-stp_10.42.42.5(pid=28336): stdout: | (launched: 2022-12-09_10:51:21.214274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:22.702659 run osmo-stp_10.42.42.5(pid=28336): stderr: | 20221209105121404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105121404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105121404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105121404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105121405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105121405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105121405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:22.825546 run osmo-stp_10.42.42.5(pid=28336): stdout: | (launched: 2022-12-09_10:51:21.214274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:22.942925 run osmo-stp_10.42.42.5(pid=28336): stderr: | 20221209105121404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105121404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105121404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105121404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105121405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105121405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105121405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:23.083700 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28336): Process ended prematurely: osmo-stp_10.42.42.5(pid=28336) [trial-2358↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28336)] [trial-2358↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 10:51:23.092142 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 10:51:23.118237 run osmo-hlr_10.42.42.2(pid=28333): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28333)] 10:51:23.165698 run osmo-hlr_10.42.42.2(pid=28333): stdout: | (launched: 2022-12-09_10:51:20.226306) 10:51:23.215317 run osmo-hlr_10.42.42.2(pid=28333): stderr: | 20221209105120421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105120421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105120421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105120421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105120421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105120421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105120434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105120442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105120442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105120443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:23.284811 run osmo-msc_10.42.42.6(pid=28339): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28339)] 10:51:23.332057 run osmo-msc_10.42.42.6(pid=28339): stdout: | (launched: 2022-12-09_10:51:22.233278) 10:51:23.381207 run osmo-msc_10.42.42.6(pid=28339): stderr: | 20221209105122504 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105122504 DLGLOBAL DEBUG validating counter group 0x7f33e17a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105122504 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105122504 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105122504 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105122505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105122506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105122507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105122507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105122507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:23.430599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28332): Terminating (SIGTERM) 10:51:23.470153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28335): Terminating (SIGTERM) 10:51:23.509530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28338): Terminating (SIGTERM) 10:51:23.549452 --- ParallelTerminationStrategy: PID 28332 died... 10:51:23.568596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28332): Terminated: ok {rc=0} 10:51:23.612485 --- ParallelTerminationStrategy: PID 28335 died... 10:51:23.630988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28335): Terminated: ok {rc=0} 10:51:23.674357 --- ParallelTerminationStrategy: PID 28338 died... 10:51:23.693095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28338): Terminated: ok {rc=0} 10:51:23.779201 bus /sierra_3: Setting Powered False 10:51:24.880087 bus /sierra_3: Setting Powered False 10:51:25.996232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 10:51:27.221718 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:27.226902 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:51:27.251870 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 10:51:27.259362 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 10:51:27.294179 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:51:27.319052 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 10:51:27.326753 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 10:51:27.843798 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 10:51:27.850205 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 10:51:27.861682 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:27.901331 tst assert_extension.py: using LAC 20954 10:51:28.025358 tst assert_extension.py: using RAC 44 10:51:28.149306 tst assert_extension.py: using CellId 20954 10:51:28.272926 tst assert_extension.py: using BVCI 20955 10:51:28.388406 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 10:51:28.500837 tst assert_extension.py:10: start nitb and bts... 10:51:28.698386 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:51:29.303579 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28344): Launched 10:51:29.602462 run osmo-nitb_10.42.42.2(pid=28345): Launched 10:51:29.768496 run osmo-nitb_10.42.42.2(pid=28345): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28345)] 10:51:29.901475 run osmo-nitb_10.42.42.2(pid=28345): stdout: | (launched: 2022-12-09_10:51:29.547177) 10:51:30.035492 run osmo-nitb_10.42.42.2(pid=28345): stderr: | (launched: 2022-12-09_10:51:29.591337) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:51:30.169721 run osmo-nitb_10.42.42.2(pid=28345): stdout: | (launched: 2022-12-09_10:51:29.547177) 10:51:30.298869 run osmo-nitb_10.42.42.2(pid=28345): stderr: | (launched: 2022-12-09_10:51:29.591337) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28345): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28345) [trial-2358↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28345)] 10:51:30.716534 tst osmo-nitb_10.42.42.2(pid=28345): stdout: | (launched: 2022-12-09_10:51:29.547177) 10:51:30.836477 tst osmo-nitb_10.42.42.2(pid=28345): stderr: | (launched: 2022-12-09_10:51:29.591337) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:51:31.002820 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28345): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28345) [trial-2358↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28345)] [trial-2358↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 10:51:31.011836 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:51:31.019065 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28344): Terminating (SIGTERM) 10:51:31.229490 --- ParallelTerminationStrategy: PID 28344 died... 10:51:31.250690 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28344): Terminated: ok {rc=0} 10:51:31.355688 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:nanobts+band-1900 --------------------------------------------------------------------- 10:51:32.528182 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:32.533154 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:51:32.556450 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:51:32.583578 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 10:51:32.618593 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:51:32.643573 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:51:32.670762 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 10:51:33.199276 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 10:51:33.204838 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:33.216122 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:33.259891 tst assert_extension.py: using LAC 20955 10:51:33.385496 tst assert_extension.py: using RAC 45 10:51:33.510912 tst assert_extension.py: using CellId 20955 10:51:33.635805 tst assert_extension.py: using BVCI 20956 10:51:33.753302 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:33.764595 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:33.775881 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:33.787274 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:33.798892 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:33.810548 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 10:51:33.926104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:34.386972 run create_hlr_db(pid=28349): Launched 10:51:34.509713 bus /sierra_2: Setting Powered False 10:51:35.568541 run create_hlr_db(pid=28349): Terminated: ok {rc=0} 10:51:36.002612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28351): Launched 10:51:36.320491 run osmo-hlr_10.42.42.2(pid=28352): Launched 10:51:36.442509 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:36.990728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28354): Launched 10:51:37.310061 run osmo-stp_10.42.42.5(pid=28355): Launched 10:51:37.434759 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:38.011561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28357): Launched 10:51:38.328745 run osmo-msc_10.42.42.6(pid=28358): Launched 10:51:38.507114 run osmo-stp_10.42.42.5(pid=28355): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28355)] 10:51:38.641627 run osmo-stp_10.42.42.5(pid=28355): stdout: | (launched: 2022-12-09_10:51:37.250418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:38.775763 run osmo-stp_10.42.42.5(pid=28355): stderr: | 20221209105137440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105137440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105137440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105137441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105137441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105137441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105137441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:38.908923 run osmo-stp_10.42.42.5(pid=28355): stdout: | (launched: 2022-12-09_10:51:37.250418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:39.034710 run osmo-stp_10.42.42.5(pid=28355): stderr: | 20221209105137440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105137440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105137440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105137441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105137441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105137441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105137441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:39.185041 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28355): Process ended prematurely: osmo-stp_10.42.42.5(pid=28355) [trial-2358↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28355)] [trial-2358↪ussd:nanobts+band-1900↪assert_extension.py:17] 10:51:39.194163 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:51:39.222039 run osmo-hlr_10.42.42.2(pid=28352): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28352)] 10:51:39.272919 run osmo-hlr_10.42.42.2(pid=28352): stdout: | (launched: 2022-12-09_10:51:36.261986) 10:51:39.325482 run osmo-hlr_10.42.42.2(pid=28352): stderr: | 20221209105136456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105136456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105136456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105136456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105136456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105136456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105136514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105136523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105136523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105136523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:39.398224 run osmo-msc_10.42.42.6(pid=28358): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28358)] 10:51:39.448690 run osmo-msc_10.42.42.6(pid=28358): stdout: | (launched: 2022-12-09_10:51:38.270066) 10:51:39.500856 run osmo-msc_10.42.42.6(pid=28358): stderr: | 20221209105138589 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105138589 DLGLOBAL DEBUG validating counter group 0x7fb73134cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105138589 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105138589 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105138589 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105138590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105138591 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105138592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105138592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105138592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:39.553609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28351): Terminating (SIGTERM) 10:51:39.595924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28354): Terminating (SIGTERM) 10:51:39.638693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28357): Terminating (SIGTERM) 10:51:39.681612 --- ParallelTerminationStrategy: PID 28351 died... 10:51:39.701713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28351): Terminated: ok {rc=0} 10:51:39.749073 --- ParallelTerminationStrategy: PID 28354 died... 10:51:39.768828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28354): Terminated: ok {rc=0} 10:51:39.815836 --- ParallelTerminationStrategy: PID 28357 died... 10:51:39.835573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28357): Terminated: ok {rc=0} 10:51:39.924177 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:51:41.130770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:41.138997 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:51:41.164312 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:51:41.191279 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:51:41.243279 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:51:41.266670 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:51:41.293133 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:51:41.843938 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:51:41.894035 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:41.905445 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:51:41.966012 tst mo_mt_call.py: using LAC 20956 10:51:42.084834 tst mo_mt_call.py: using RAC 46 10:51:42.213599 tst mo_mt_call.py: using CellId 20956 10:51:42.340618 tst mo_mt_call.py: using BVCI 20957 10:51:42.458082 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:42.469955 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:42.481618 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:42.493629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:42.505691 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:42.518555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:51:42.632836 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:51:42.750038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:43.219479 run create_hlr_db(pid=28363): Launched 10:51:43.348061 bus /sierra_2: Setting Powered False 10:51:44.412309 run create_hlr_db(pid=28363): Terminated: ok {rc=0} 10:51:44.846491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28365): Launched 10:51:45.149811 run osmo-hlr_10.42.42.2(pid=28366): Launched 10:51:45.265720 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:45.787199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28368): Launched 10:51:46.113768 run osmo-stp_10.42.42.5(pid=28369): Launched 10:51:46.383431 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:46.984484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28371): Launched 10:51:47.317516 run osmo-msc_10.42.42.6(pid=28372): Launched 10:51:47.501648 run osmo-stp_10.42.42.5(pid=28369): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28369)] 10:51:47.640330 run osmo-stp_10.42.42.5(pid=28369): stdout: | (launched: 2022-12-09_10:51:46.052879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:47.778094 run osmo-stp_10.42.42.5(pid=28369): stderr: | 20221209105146254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105146254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105146254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105146254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105146255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105146255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105146255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:47.914515 run osmo-stp_10.42.42.5(pid=28369): stdout: | (launched: 2022-12-09_10:51:46.052879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:48.044625 run osmo-stp_10.42.42.5(pid=28369): stderr: | 20221209105146254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105146254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105146254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105146254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105146255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105146255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105146255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:48.200038 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28369): Process ended prematurely: osmo-stp_10.42.42.5(pid=28369) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28369)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:51:48.209961 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:51:48.238776 run osmo-hlr_10.42.42.2(pid=28366): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28366)] 10:51:48.289280 run osmo-hlr_10.42.42.2(pid=28366): stdout: | (launched: 2022-12-09_10:51:45.094053) 10:51:48.341583 run osmo-hlr_10.42.42.2(pid=28366): stderr: | 20221209105145267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105145267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105145267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105145267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105145267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105145267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105145307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105145318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105145318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105145319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:48.414283 run osmo-msc_10.42.42.6(pid=28372): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28372)] 10:51:48.464925 run osmo-msc_10.42.42.6(pid=28372): stdout: | (launched: 2022-12-09_10:51:47.257996) 10:51:48.517358 run osmo-msc_10.42.42.6(pid=28372): stderr: | 20221209105147577 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105147577 DLGLOBAL DEBUG validating counter group 0x7f71fb396c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105147577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105147577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105147577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105147578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105147579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105147580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105147580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105147580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:48.570030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28365): Terminating (SIGTERM) 10:51:48.612361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28368): Terminating (SIGTERM) 10:51:48.655049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28371): Terminating (SIGTERM) 10:51:48.697686 --- ParallelTerminationStrategy: PID 28365 died... 10:51:48.717718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28365): Terminated: ok {rc=0} 10:51:48.764687 --- ParallelTerminationStrategy: PID 28368 died... 10:51:48.784569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28368): Terminated: ok {rc=0} 10:51:48.831395 --- ParallelTerminationStrategy: PID 28371 died... 10:51:48.851182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28371): Terminated: ok {rc=0} 10:51:48.940773 bus /sierra_3: Setting Powered False 10:51:50.039984 bus /sierra_3: Setting Powered False 10:51:51.156557 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:51:52.306346 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:52.319003 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:51:52.381988 tst mo_mt_call_osmux.py: using LAC 20957 10:51:52.510033 tst mo_mt_call_osmux.py: using RAC 47 10:51:52.638699 tst mo_mt_call_osmux.py: using CellId 20957 10:51:52.773263 tst mo_mt_call_osmux.py: using BVCI 20958 10:51:52.892665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:52.904296 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:52.915702 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:52.927414 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:52.939299 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:52.950904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:51:53.067398 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:51:53.185054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:53.659380 run create_hlr_db(pid=28374): Launched 10:51:53.784852 bus /sierra_2: Setting Powered False 10:51:54.843783 run create_hlr_db(pid=28374): Terminated: ok {rc=0} 10:51:55.285744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28376): Launched 10:51:55.613690 run osmo-hlr_10.42.42.2(pid=28377): Launched 10:51:55.738711 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:56.297855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28379): Launched 10:51:56.624606 run osmo-stp_10.42.42.5(pid=28380): Launched 10:51:56.748798 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:57.335796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28382): Launched 10:51:57.663261 run osmo-msc_10.42.42.6(pid=28383): Launched 10:51:57.846519 run osmo-stp_10.42.42.5(pid=28380): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28380)] 10:51:57.983815 run osmo-stp_10.42.42.5(pid=28380): stdout: | (launched: 2022-12-09_10:51:56.564803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:58.121593 run osmo-stp_10.42.42.5(pid=28380): stderr: | 20221209105156754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105156754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105156754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105156754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105156755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105156755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105156755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:58.257291 run osmo-stp_10.42.42.5(pid=28380): stdout: | (launched: 2022-12-09_10:51:56.564803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:58.386987 run osmo-stp_10.42.42.5(pid=28380): stderr: | 20221209105156754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105156754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105156754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105156754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105156755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105156755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105156755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:58.542229 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28380): Process ended prematurely: osmo-stp_10.42.42.5(pid=28380) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28380)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:51:58.552163 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:51:58.580573 run osmo-hlr_10.42.42.2(pid=28377): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28377)] 10:51:58.632000 run osmo-hlr_10.42.42.2(pid=28377): stdout: | (launched: 2022-12-09_10:51:55.553430) 10:51:58.685218 run osmo-hlr_10.42.42.2(pid=28377): stderr: | 20221209105155750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105155750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105155750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105155750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105155750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105155750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105155764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105155774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105155774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105155774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:58.758309 run osmo-msc_10.42.42.6(pid=28383): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28383)] 10:51:58.809086 run osmo-msc_10.42.42.6(pid=28383): stdout: | (launched: 2022-12-09_10:51:57.602601) 10:51:58.861380 run osmo-msc_10.42.42.6(pid=28383): stderr: | 20221209105157925 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105157925 DLGLOBAL DEBUG validating counter group 0x7f22b76f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105157925 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105157925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105157926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105157926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105157927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105157928 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105157928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105157928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:58.914149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28376): Terminating (SIGTERM) 10:51:58.956420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28379): Terminating (SIGTERM) 10:51:58.998563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28382): Terminating (SIGTERM) 10:51:59.041123 --- ParallelTerminationStrategy: PID 28376 died... 10:51:59.061182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28376): Terminated: ok {rc=0} 10:51:59.108355 --- ParallelTerminationStrategy: PID 28379 died... 10:51:59.128160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28379): Terminated: ok {rc=0} 10:51:59.174968 --- ParallelTerminationStrategy: PID 28382 died... 10:51:59.194658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28382): Terminated: ok {rc=0} 10:51:59.282513 bus /sierra_3: Setting Powered False 10:52:00.381282 bus /sierra_3: Setting Powered False 10:52:01.498535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:52:02.760272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:02.768481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:52:02.794882 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:52:02.822769 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:52:02.874074 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:52:02.898090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:52:02.925335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:52:03.480612 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:52:03.532911 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:03.544533 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:52:03.607096 tst mo_mt_call.py: using LAC 20958 10:52:03.733770 tst mo_mt_call.py: using RAC 48 10:52:03.860629 tst mo_mt_call.py: using CellId 20958 10:52:03.985600 tst mo_mt_call.py: using BVCI 20959 10:52:04.102804 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:04.114395 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:04.125835 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:04.137619 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:04.149413 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:04.161056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:52:04.280528 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:52:04.400479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:04.903640 run create_hlr_db(pid=28388): Launched 10:52:05.027466 bus /sierra_2: Setting Powered False 10:52:06.090886 run create_hlr_db(pid=28388): Terminated: ok {rc=0} 10:52:06.524634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28390): Launched 10:52:06.828255 run osmo-hlr_10.42.42.2(pid=28391): Launched 10:52:06.944300 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:07.469624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28393): Launched 10:52:07.775887 run osmo-stp_10.42.42.5(pid=28394): Launched 10:52:07.891729 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:08.441155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28396): Launched 10:52:08.744708 run osmo-msc_10.42.42.6(pid=28397): Launched 10:52:08.914635 run osmo-stp_10.42.42.5(pid=28394): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28394)] 10:52:09.042729 run osmo-stp_10.42.42.5(pid=28394): stdout: | (launched: 2022-12-09_10:52:07.719069) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:09.170512 run osmo-stp_10.42.42.5(pid=28394): stderr: | 20221209105207886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105207886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105207887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105207887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105207888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105207888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105207888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:09.296660 run osmo-stp_10.42.42.5(pid=28394): stdout: | (launched: 2022-12-09_10:52:07.719069) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:09.417710 run osmo-stp_10.42.42.5(pid=28394): stderr: | 20221209105207886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105207886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105207887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105207887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105207888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105207888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105207888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:09.562241 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28394): Process ended prematurely: osmo-stp_10.42.42.5(pid=28394) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28394)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:52:09.571458 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:52:09.598152 run osmo-hlr_10.42.42.2(pid=28391): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28391)] 10:52:09.646318 run osmo-hlr_10.42.42.2(pid=28391): stdout: | (launched: 2022-12-09_10:52:06.771855) 10:52:09.695735 run osmo-hlr_10.42.42.2(pid=28391): stderr: | 20221209105206945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105206945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105206946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105206946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105206946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105206946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105206958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105206968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105206968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105206968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:09.764431 run osmo-msc_10.42.42.6(pid=28397): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28397)] 10:52:09.811933 run osmo-msc_10.42.42.6(pid=28397): stdout: | (launched: 2022-12-09_10:52:08.688651) 10:52:09.861131 run osmo-msc_10.42.42.6(pid=28397): stderr: | 20221209105208959 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105208959 DLGLOBAL DEBUG validating counter group 0x7f0eda0b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105208959 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105208959 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105208959 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105208959 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105208961 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105208962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105208962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105208962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:09.910422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28390): Terminating (SIGTERM) 10:52:09.950073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28393): Terminating (SIGTERM) 10:52:09.989635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28396): Terminating (SIGTERM) 10:52:10.029775 --- ParallelTerminationStrategy: PID 28390 died... 10:52:10.048782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28390): Terminated: ok {rc=0} 10:52:10.092541 --- ParallelTerminationStrategy: PID 28393 died... 10:52:10.111171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28393): Terminated: ok {rc=0} 10:52:10.154924 --- ParallelTerminationStrategy: PID 28396 died... 10:52:10.173383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28396): Terminated: ok {rc=0} 10:52:10.257043 bus /sierra_3: Setting Powered False 10:52:11.355727 bus /sierra_3: Setting Powered False 10:52:12.472651 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:52:13.615741 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:13.627421 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:52:13.686717 tst mo_mt_call_osmux.py: using LAC 20959 10:52:13.809425 tst mo_mt_call_osmux.py: using RAC 49 10:52:13.927855 tst mo_mt_call_osmux.py: using CellId 20959 10:52:14.044845 tst mo_mt_call_osmux.py: using BVCI 20960 10:52:14.154123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:14.165451 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:14.176391 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:14.187607 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:14.198824 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:52:14.209743 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:52:14.327761 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:52:14.448019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:14.951793 run create_hlr_db(pid=28399): Launched 10:52:15.077462 bus /sierra_2: Setting Powered False 10:52:16.142399 run create_hlr_db(pid=28399): Terminated: ok {rc=0} 10:52:16.605237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28401): Launched 10:52:16.948884 run osmo-hlr_10.42.42.2(pid=28402): Launched 10:52:17.177994 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:17.698508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28404): Launched 10:52:18.003089 run osmo-stp_10.42.42.5(pid=28405): Launched 10:52:18.118752 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:18.680481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28407): Launched 10:52:18.983022 run osmo-msc_10.42.42.6(pid=28408): Launched 10:52:19.152342 run osmo-stp_10.42.42.5(pid=28405): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28405)] 10:52:19.279735 run osmo-stp_10.42.42.5(pid=28405): stdout: | (launched: 2022-12-09_10:52:17.947179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:19.407729 run osmo-stp_10.42.42.5(pid=28405): stderr: | 20221209105218118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105218118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105218118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105218119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105218119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105218119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105218119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:19.533502 run osmo-stp_10.42.42.5(pid=28405): stdout: | (launched: 2022-12-09_10:52:17.947179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:19.653790 run osmo-stp_10.42.42.5(pid=28405): stderr: | 20221209105218118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105218118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105218118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105218119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105218119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105218119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105218119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:19.798895 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28405): Process ended prematurely: osmo-stp_10.42.42.5(pid=28405) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28405)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:52:19.808138 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:52:19.834760 run osmo-hlr_10.42.42.2(pid=28402): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28402)] 10:52:19.882670 run osmo-hlr_10.42.42.2(pid=28402): stdout: | (launched: 2022-12-09_10:52:16.888257) 10:52:19.932272 run osmo-hlr_10.42.42.2(pid=28402): stderr: | 20221209105217101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105217101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105217101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105217101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105217101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105217101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105217128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105217136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105217136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105217141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:20.001035 run osmo-msc_10.42.42.6(pid=28408): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28408)] 10:52:20.048686 run osmo-msc_10.42.42.6(pid=28408): stdout: | (launched: 2022-12-09_10:52:18.927172) 10:52:20.098177 run osmo-msc_10.42.42.6(pid=28408): stderr: | 20221209105219199 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105219200 DLGLOBAL DEBUG validating counter group 0x7efd0fa1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105219200 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105219200 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105219200 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105219200 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105219202 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105219202 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105219203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105219203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:20.148137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28401): Terminating (SIGTERM) 10:52:20.187876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28404): Terminating (SIGTERM) 10:52:20.227735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28407): Terminating (SIGTERM) 10:52:20.267514 --- ParallelTerminationStrategy: PID 28401 died... 10:52:20.286552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28401): Terminated: ok {rc=0} 10:52:20.330395 --- ParallelTerminationStrategy: PID 28404 died... 10:52:20.349124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28404): Terminated: ok {rc=0} 10:52:20.392796 --- ParallelTerminationStrategy: PID 28407 died... 10:52:20.411614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28407): Terminated: ok {rc=0} 10:52:20.495755 bus /sierra_3: Setting Powered False 10:52:21.594717 bus /sierra_3: Setting Powered False 10:52:22.713977 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:52:23.953532 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:23.962460 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:52:23.985902 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:52:24.012112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:52:24.062068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:52:24.085474 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:52:24.111598 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:52:24.664146 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:52:24.712380 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:24.723837 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:52:24.785904 tst mo_mt_call.py: using LAC 20960 10:52:24.904917 tst mo_mt_call.py: using RAC 50 10:52:25.022437 tst mo_mt_call.py: using CellId 20960 10:52:25.139641 tst mo_mt_call.py: using BVCI 20961 10:52:25.250697 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:25.261992 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:25.272785 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:25.283679 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:25.294669 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:25.305590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:52:25.425947 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:52:25.546056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:26.050478 run create_hlr_db(pid=28413): Launched 10:52:26.177947 bus /sierra_2: Setting Powered False 10:52:27.242737 run create_hlr_db(pid=28413): Terminated: ok {rc=0} 10:52:27.693278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28415): Launched 10:52:28.017789 run osmo-hlr_10.42.42.2(pid=28416): Launched 10:52:28.142419 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:28.709272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28418): Launched 10:52:29.034672 run osmo-stp_10.42.42.5(pid=28419): Launched 10:52:29.160802 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:29.746851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28421): Launched 10:52:30.072157 run osmo-msc_10.42.42.6(pid=28422): Launched 10:52:30.254931 run osmo-stp_10.42.42.5(pid=28419): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28419)] 10:52:30.391589 run osmo-stp_10.42.42.5(pid=28419): stdout: | (launched: 2022-12-09_10:52:28.975263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:30.528400 run osmo-stp_10.42.42.5(pid=28419): stderr: | 20221209105229164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105229164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105229164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105229165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105229165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105229165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105229165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:30.663958 run osmo-stp_10.42.42.5(pid=28419): stdout: | (launched: 2022-12-09_10:52:28.975263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:30.793420 run osmo-stp_10.42.42.5(pid=28419): stderr: | 20221209105229164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105229164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105229164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105229165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105229165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105229165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105229165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:30.950557 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28419): Process ended prematurely: osmo-stp_10.42.42.5(pid=28419) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28419)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:52:30.961201 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:52:30.991563 run osmo-hlr_10.42.42.2(pid=28416): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28416)] 10:52:31.043758 run osmo-hlr_10.42.42.2(pid=28416): stdout: | (launched: 2022-12-09_10:52:27.958312) 10:52:31.097511 run osmo-hlr_10.42.42.2(pid=28416): stderr: | 20221209105228153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105228153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105228153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105228153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105228154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105228154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105228166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105228175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105228175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105228175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:31.172345 run osmo-msc_10.42.42.6(pid=28422): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28422)] 10:52:31.224350 run osmo-msc_10.42.42.6(pid=28422): stdout: | (launched: 2022-12-09_10:52:30.012316) 10:52:31.278182 run osmo-msc_10.42.42.6(pid=28422): stderr: | 20221209105230333 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105230333 DLGLOBAL DEBUG validating counter group 0x7f43b6083c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105230333 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105230334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105230334 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105230334 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105230336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105230336 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105230336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105230336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:31.332621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28415): Terminating (SIGTERM) 10:52:31.377093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28418): Terminating (SIGTERM) 10:52:31.422818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28421): Terminating (SIGTERM) 10:52:31.468908 --- ParallelTerminationStrategy: PID 28415 died... 10:52:31.489738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28415): Terminated: ok {rc=0} 10:52:31.539804 --- ParallelTerminationStrategy: PID 28418 died... 10:52:31.560411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28418): Terminated: ok {rc=0} 10:52:31.609086 --- ParallelTerminationStrategy: PID 28421 died... 10:52:31.629595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28421): Terminated: ok {rc=0} 10:52:31.720299 bus /sierra_3: Setting Powered False 10:52:32.818867 bus /sierra_3: Setting Powered False 10:52:33.934204 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:52:35.080667 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:35.092612 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:52:35.153163 tst mo_mt_call_osmux.py: using LAC 20961 10:52:35.273593 tst mo_mt_call_osmux.py: using RAC 51 10:52:35.397199 tst mo_mt_call_osmux.py: using CellId 20961 10:52:35.514512 tst mo_mt_call_osmux.py: using BVCI 20962 10:52:35.625699 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:35.636696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:35.647759 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:35.658776 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:35.669890 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:52:35.680847 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:52:35.797985 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:52:35.918940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:36.421843 run create_hlr_db(pid=28424): Launched 10:52:36.548641 bus /sierra_2: Setting Powered False 10:52:37.613070 run create_hlr_db(pid=28424): Terminated: ok {rc=0} 10:52:38.063688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28426): Launched 10:52:38.390125 run osmo-hlr_10.42.42.2(pid=28427): Launched 10:52:38.516077 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:39.072702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28429): Launched 10:52:39.397293 run osmo-stp_10.42.42.5(pid=28430): Launched 10:52:39.522937 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:40.116129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28432): Launched 10:52:40.442751 run osmo-msc_10.42.42.6(pid=28433): Launched 10:52:40.626718 run osmo-stp_10.42.42.5(pid=28430): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28430)] 10:52:40.763993 run osmo-stp_10.42.42.5(pid=28430): stdout: | (launched: 2022-12-09_10:52:39.337740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:40.901388 run osmo-stp_10.42.42.5(pid=28430): stderr: | 20221209105239525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105239525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105239525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105239526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105239526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105239526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105239526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:41.036740 run osmo-stp_10.42.42.5(pid=28430): stdout: | (launched: 2022-12-09_10:52:39.337740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:41.166297 run osmo-stp_10.42.42.5(pid=28430): stderr: | 20221209105239525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105239525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105239525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105239526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105239526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105239526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105239526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:41.321263 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28430): Process ended prematurely: osmo-stp_10.42.42.5(pid=28430) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28430)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:52:41.330990 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:52:41.359401 run osmo-hlr_10.42.42.2(pid=28427): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28427)] 10:52:41.410280 run osmo-hlr_10.42.42.2(pid=28427): stdout: | (launched: 2022-12-09_10:52:38.330640) 10:52:41.462476 run osmo-hlr_10.42.42.2(pid=28427): stderr: | 20221209105238525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105238525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105238525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105238525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105238525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105238525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105238538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105238546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105238546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105238546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:41.535059 run osmo-msc_10.42.42.6(pid=28433): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28433)] 10:52:41.585921 run osmo-msc_10.42.42.6(pid=28433): stdout: | (launched: 2022-12-09_10:52:40.383184) 10:52:41.638044 run osmo-msc_10.42.42.6(pid=28433): stderr: | 20221209105240703 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105240703 DLGLOBAL DEBUG validating counter group 0x7f960bef6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105240704 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105240704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105240704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105240704 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105240706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105240706 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105240706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105240706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:41.690856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28426): Terminating (SIGTERM) 10:52:41.733144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28429): Terminating (SIGTERM) 10:52:41.774771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28432): Terminating (SIGTERM) 10:52:41.817483 --- ParallelTerminationStrategy: PID 28426 died... 10:52:41.837569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28426): Terminated: ok {rc=0} 10:52:41.884513 --- ParallelTerminationStrategy: PID 28429 died... 10:52:41.904194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28429): Terminated: ok {rc=0} 10:52:41.951022 --- ParallelTerminationStrategy: PID 28432 died... 10:52:41.970625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28432): Terminated: ok {rc=0} 10:52:42.058372 bus /sierra_3: Setting Powered False 10:52:43.157216 bus /sierra_3: Setting Powered False 10:52:44.273053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:52:45.510907 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:45.518264 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:52:45.542043 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:52:45.568296 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:52:45.618833 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:52:45.642134 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:52:45.668364 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:52:46.219307 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:52:46.271099 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:46.283381 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:52:46.344320 tst mo_mt_call.py: using LAC 20962 10:52:46.488824 tst mo_mt_call.py: using RAC 52 10:52:46.623913 tst mo_mt_call.py: using CellId 20962 10:52:46.765304 tst mo_mt_call.py: using BVCI 20963 10:52:46.875997 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:46.887355 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:46.898495 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:46.910675 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:46.922862 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:46.934862 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:47.054101 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:47.169955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:47.640053 run create_hlr_db(pid=28438): Launched 10:52:47.765097 bus /sierra_2: Setting Powered False 10:52:48.825523 run create_hlr_db(pid=28438): Terminated: ok {rc=0} 10:52:49.245298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Launched 10:52:49.548118 run osmo-hlr_10.42.42.2(pid=28441): Launched 10:52:49.663279 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:50.199721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Launched 10:52:50.502577 run osmo-stp_10.42.42.5(pid=28444): Launched 10:52:50.618116 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:51.164817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28446): Launched 10:52:51.466770 run osmo-msc_10.42.42.6(pid=28447): Launched 10:52:51.637920 run osmo-stp_10.42.42.5(pid=28444): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] 10:52:51.765399 run osmo-stp_10.42.42.5(pid=28444): stdout: | (launched: 2022-12-09_10:52:50.446426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:51.892792 run osmo-stp_10.42.42.5(pid=28444): stderr: | 20221209105250613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105250613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105250613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105250614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105250614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105250614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105250615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:52.018727 run osmo-stp_10.42.42.5(pid=28444): stdout: | (launched: 2022-12-09_10:52:50.446426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:52.138736 run osmo-stp_10.42.42.5(pid=28444): stderr: | 20221209105250613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105250613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105250613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105250614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105250614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105250614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105250615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:52.282403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28444): Process ended prematurely: osmo-stp_10.42.42.5(pid=28444) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:52:52.291419 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:52:52.318051 run osmo-hlr_10.42.42.2(pid=28441): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28441)] 10:52:52.365617 run osmo-hlr_10.42.42.2(pid=28441): stdout: | (launched: 2022-12-09_10:52:49.492403) 10:52:52.415223 run osmo-hlr_10.42.42.2(pid=28441): stderr: | 20221209105249666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105249666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105249666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105249666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105249666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105249666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105249678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105249688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105249688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105249688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:52.484590 run osmo-msc_10.42.42.6(pid=28447): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28447)] 10:52:52.532012 run osmo-msc_10.42.42.6(pid=28447): stdout: | (launched: 2022-12-09_10:52:51.410879) 10:52:52.581430 run osmo-msc_10.42.42.6(pid=28447): stderr: | 20221209105251682 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105251682 DLGLOBAL DEBUG validating counter group 0x7faffae0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105251682 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105251682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105251682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105251683 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105251684 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105251685 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105251685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105251685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:52.631348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Terminating (SIGTERM) 10:52:52.670989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Terminating (SIGTERM) 10:52:52.710698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28446): Terminating (SIGTERM) 10:52:52.750772 --- ParallelTerminationStrategy: PID 28440 died... 10:52:52.769957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Terminated: ok {rc=0} 10:52:52.814003 --- ParallelTerminationStrategy: PID 28443 died... 10:52:52.832342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Terminated: ok {rc=0} 10:52:52.876257 --- ParallelTerminationStrategy: PID 28446 died... 10:52:52.894972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28446): Terminated: ok {rc=0} 10:52:52.977946 bus /sierra_3: Setting Powered False 10:52:54.077592 bus /sierra_3: Setting Powered False 10:52:55.196827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:52:56.347277 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:56.359484 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:52:56.420916 tst mo_mt_call_osmux.py: using LAC 20963 10:52:56.549449 tst mo_mt_call_osmux.py: using RAC 53 10:52:56.676754 tst mo_mt_call_osmux.py: using CellId 20963 10:52:56.802609 tst mo_mt_call_osmux.py: using BVCI 20964 10:52:56.919863 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:56.931507 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:56.943042 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:56.954896 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:56.966719 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:56.978383 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:57.099191 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:57.214013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:57.684659 run create_hlr_db(pid=28449): Launched 10:52:57.808781 bus /sierra_2: Setting Powered False 10:52:58.870023 run create_hlr_db(pid=28449): Terminated: ok {rc=0} 10:52:59.312141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28451): Launched 10:52:59.636096 run osmo-hlr_10.42.42.2(pid=28452): Launched 10:52:59.761580 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:00.323073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28454): Launched 10:53:00.648838 run osmo-stp_10.42.42.5(pid=28455): Launched 10:53:00.775108 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:01.400056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28457): Launched 10:53:01.782999 run osmo-msc_10.42.42.6(pid=28468): Launched 10:53:02.115572 run osmo-stp_10.42.42.5(pid=28455): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28455)] 10:53:02.408470 run osmo-stp_10.42.42.5(pid=28455): stdout: | (launched: 2022-12-09_10:53:00.589324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:02.672217 run osmo-stp_10.42.42.5(pid=28455): stderr: | 20221209105300780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105300780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105300780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105300781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105300781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105300781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105300781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:02.817335 run osmo-stp_10.42.42.5(pid=28455): stdout: | (launched: 2022-12-09_10:53:00.589324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:02.941351 run osmo-stp_10.42.42.5(pid=28455): stderr: | 20221209105300780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105300780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105300780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105300781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105300781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105300781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105300781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:03.103886 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28455): Process ended prematurely: osmo-stp_10.42.42.5(pid=28455) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28455)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:53:03.113840 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 10:53:03.148883 run osmo-hlr_10.42.42.2(pid=28452): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28452)] 10:53:03.198230 run osmo-hlr_10.42.42.2(pid=28452): stdout: | (launched: 2022-12-09_10:52:59.576557) 10:53:03.256033 run osmo-hlr_10.42.42.2(pid=28452): stderr: | 20221209105259771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105259771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105259771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105259771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105259771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105259771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105259783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105259792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105259793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105259793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:03.341759 run osmo-msc_10.42.42.6(pid=28468): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28468)] 10:53:03.405543 run osmo-msc_10.42.42.6(pid=28468): stdout: | (launched: 2022-12-09_10:53:01.725501) 10:53:03.468322 run osmo-msc_10.42.42.6(pid=28468): stderr: | 20221209105302302 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105302303 DLGLOBAL DEBUG validating counter group 0x7f848c068c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105302303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105302303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105302303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105302303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105302305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105302306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105302306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105302306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:03.536373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28451): Terminating (SIGTERM) 10:53:03.590360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28454): Terminating (SIGTERM) 10:53:03.642530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28457): Terminating (SIGTERM) 10:53:03.692499 --- ParallelTerminationStrategy: PID 28451 died... 10:53:03.719755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28451): Terminated: ok {rc=0} 10:53:03.781064 --- ParallelTerminationStrategy: PID 28454 died... 10:53:03.801829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28454): Terminated: ok {rc=0} 10:53:03.858638 --- ParallelTerminationStrategy: PID 28457 died... 10:53:03.881938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28457): Terminated: ok {rc=0} 10:53:03.995112 bus /sierra_3: Setting Powered False 10:53:05.110888 bus /sierra_3: Setting Powered False 10:53:06.232230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:53:07.482164 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:07.491144 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:53:07.521029 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:53:07.550581 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:53:07.603982 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:53:07.629513 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:53:07.658827 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:53:08.211116 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:53:08.266842 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:08.279585 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:53:08.344515 tst mo_mt_call.py: using LAC 20964 10:53:08.472112 tst mo_mt_call.py: using RAC 54 10:53:08.601673 tst mo_mt_call.py: using CellId 20964 10:53:08.731670 tst mo_mt_call.py: using BVCI 20965 10:53:08.854103 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:08.866640 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:08.879121 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:08.893721 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:08.908528 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:08.921017 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:53:09.047233 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:53:09.172603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:09.690558 run create_hlr_db(pid=28735): Launched 10:53:09.857138 bus /sierra_2: Setting Powered False 10:53:10.923737 run create_hlr_db(pid=28735): Terminated: ok {rc=0} 10:53:11.389602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28737): Launched 10:53:11.737659 run osmo-hlr_10.42.42.2(pid=28738): Launched 10:53:11.994748 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:12.643570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28740): Launched 10:53:12.967057 run osmo-stp_10.42.42.5(pid=28741): Launched 10:53:13.199612 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:13.908326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Launched 10:53:14.258562 run osmo-msc_10.42.42.6(pid=28744): Launched 10:53:14.645204 run osmo-stp_10.42.42.5(pid=28741): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] 10:53:14.964786 run osmo-stp_10.42.42.5(pid=28741): stdout: | (launched: 2022-12-09_10:53:12.906226) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:15.115019 run osmo-stp_10.42.42.5(pid=28741): stderr: | 20221209105313230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105313230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105313230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105313231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105313231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105313231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105313231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:15.259796 run osmo-stp_10.42.42.5(pid=28741): stdout: | (launched: 2022-12-09_10:53:12.906226) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:15.397407 run osmo-stp_10.42.42.5(pid=28741): stderr: | 20221209105313230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105313230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105313230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105313231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105313231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105313231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105313231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:15.562286 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28741): Process ended prematurely: osmo-stp_10.42.42.5(pid=28741) [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:53:15.573671 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 10:53:15.606556 run osmo-hlr_10.42.42.2(pid=28738): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28738)] 10:53:15.661912 run osmo-hlr_10.42.42.2(pid=28738): stdout: | (launched: 2022-12-09_10:53:11.675870) 10:53:15.719877 run osmo-hlr_10.42.42.2(pid=28738): stderr: | 20221209105311981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105311981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105311981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105311982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105311982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105311982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105312007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105312023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105312024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105312024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:15.797532 run osmo-msc_10.42.42.6(pid=28744): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28744)] 10:53:15.872174 run osmo-msc_10.42.42.6(pid=28744): stdout: | (launched: 2022-12-09_10:53:14.197596) 10:53:15.955936 run osmo-msc_10.42.42.6(pid=28744): stderr: | 20221209105314699 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105314699 DLGLOBAL DEBUG validating counter group 0x7f0049986c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105314699 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105314699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105314700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105314700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105314709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105314710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105314710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105314710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:16.014987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28737): Terminating (SIGTERM) 10:53:16.073882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28740): Terminating (SIGTERM) 10:53:16.130316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Terminating (SIGTERM) 10:53:16.178499 --- ParallelTerminationStrategy: PID 28737 died... 10:53:16.199478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28737): Terminated: ok {rc=0} 10:53:16.256121 --- ParallelTerminationStrategy: PID 28740 died... 10:53:16.282543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28740): Terminated: ok {rc=0} 10:53:16.341951 --- ParallelTerminationStrategy: PID 28743 died... 10:53:16.373277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Terminated: ok {rc=0} 10:53:16.481622 bus /sierra_3: Setting Powered False 10:53:17.613507 bus /sierra_3: Setting Powered False 10:53:18.741405 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:53:19.903252 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:19.916614 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:53:19.982176 tst mo_mt_call_osmux.py: using LAC 20965 10:53:20.114549 tst mo_mt_call_osmux.py: using RAC 55 10:53:20.249529 tst mo_mt_call_osmux.py: using CellId 20965 10:53:20.382590 tst mo_mt_call_osmux.py: using BVCI 20966 10:53:20.507451 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:20.520162 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:20.534179 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:20.547991 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:20.561247 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:53:20.574764 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:53:20.701869 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:53:20.829801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:21.358718 run create_hlr_db(pid=28746): Launched 10:53:21.528222 bus /sierra_2: Setting Powered False 10:53:22.595507 run create_hlr_db(pid=28746): Terminated: ok {rc=0} 10:53:23.069445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28748): Launched 10:53:23.420267 run osmo-hlr_10.42.42.2(pid=28749): Launched 10:53:23.676430 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:24.359575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28751): Launched 10:53:24.711246 run osmo-stp_10.42.42.5(pid=28752): Launched 10:53:24.974823 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:25.641703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28755): Launched 10:53:25.952767 run osmo-msc_10.42.42.6(pid=28756): Launched 10:53:26.123813 run osmo-stp_10.42.42.5(pid=28752): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28752)] 10:53:26.253087 run osmo-stp_10.42.42.5(pid=28752): stdout: | (launched: 2022-12-09_10:53:24.648714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:26.381353 run osmo-stp_10.42.42.5(pid=28752): stderr: | 20221209105324949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105324950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105324950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105324950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105324951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105324951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105324951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:26.508525 run osmo-stp_10.42.42.5(pid=28752): stdout: | (launched: 2022-12-09_10:53:24.648714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:26.630482 run osmo-stp_10.42.42.5(pid=28752): stderr: | 20221209105324949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105324950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105324950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105324950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105324951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105324951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105324951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:26.776379 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28752): Process ended prematurely: osmo-stp_10.42.42.5(pid=28752) [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28752)] [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:53:26.785583 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 10:53:26.812487 run osmo-hlr_10.42.42.2(pid=28749): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28749)] 10:53:26.860785 run osmo-hlr_10.42.42.2(pid=28749): stdout: | (launched: 2022-12-09_10:53:23.359092) 10:53:26.910629 run osmo-hlr_10.42.42.2(pid=28749): stderr: | 20221209105323665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105323665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105323665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105323665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105323665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105323665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105323682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105323691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105323691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105323691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:26.980026 run osmo-msc_10.42.42.6(pid=28756): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28756)] 10:53:27.028053 run osmo-msc_10.42.42.6(pid=28756): stdout: | (launched: 2022-12-09_10:53:25.895072) 10:53:27.077833 run osmo-msc_10.42.42.6(pid=28756): stderr: | 20221209105326171 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105326171 DLGLOBAL DEBUG validating counter group 0x7fc1a3626c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105326171 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105326171 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105326172 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105326172 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105326175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105326175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105326175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105326175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:27.128137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28748): Terminating (SIGTERM) 10:53:27.168627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28751): Terminating (SIGTERM) 10:53:27.208790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28755): Terminating (SIGTERM) 10:53:27.250149 --- ParallelTerminationStrategy: PID 28748 died... 10:53:27.269457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28748): Terminated: ok {rc=0} 10:53:27.313826 --- ParallelTerminationStrategy: PID 28751 died... 10:53:27.332572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28751): Terminated: ok {rc=0} 10:53:27.377567 --- ParallelTerminationStrategy: PID 28755 died... 10:53:27.396519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28755): Terminated: ok {rc=0} 10:53:27.483651 bus /sierra_3: Setting Powered False 10:53:28.585331 bus /sierra_3: Setting Powered False 10:53:29.699590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:nanobts+band-1900 --------------------------------------------------------------------- 10:53:30.958892 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:30.969725 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:53:31.003245 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:53:31.038394 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 10:53:31.127487 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:53:31.152380 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:53:31.181866 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 10:53:31.778669 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 10:53:31.787585 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:31.803595 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:53:31.848868 tst emergency_mo_mt_call.py: using LAC 20966 10:53:31.998473 tst emergency_mo_mt_call.py: using RAC 56 10:53:32.153527 tst emergency_mo_mt_call.py: using CellId 20966 10:53:32.280613 tst emergency_mo_mt_call.py: using BVCI 20967 10:53:32.403764 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.415576 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.427374 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.440493 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.451865 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.463633 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:32.581599 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:32.698175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:33.166759 run create_hlr_db(pid=28762): Launched 10:53:33.292858 bus /sierra_2: Setting Powered False 10:53:34.353722 run create_hlr_db(pid=28762): Terminated: ok {rc=0} 10:53:34.796239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28764): Launched 10:53:35.121208 run osmo-hlr_10.42.42.2(pid=28765): Launched 10:53:35.246106 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:35.802633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28767): Launched 10:53:36.126521 run osmo-stp_10.42.42.5(pid=28768): Launched 10:53:36.259250 tst emergency_mo_mt_call.py: using MSISDN 7166 10:53:36.426981 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:37.009193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28770): Launched 10:53:37.332875 run osmo-msc_10.42.42.6(pid=28771): Launched 10:53:37.514919 run osmo-stp_10.42.42.5(pid=28768): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28768)] 10:53:37.650598 run osmo-stp_10.42.42.5(pid=28768): stdout: | (launched: 2022-12-09_10:53:36.066610) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:37.787678 run osmo-stp_10.42.42.5(pid=28768): stderr: | 20221209105336259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105336259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105336259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105336260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105336260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105336260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105336260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:37.923097 run osmo-stp_10.42.42.5(pid=28768): stdout: | (launched: 2022-12-09_10:53:36.066610) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:38.051283 run osmo-stp_10.42.42.5(pid=28768): stderr: | 20221209105336259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105336259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105336259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105336260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105336260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105336260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105336260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:38.204219 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28768): Process ended prematurely: osmo-stp_10.42.42.5(pid=28768) [trial-2358↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28768)] [trial-2358↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 10:53:38.213720 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 10:53:38.242591 run osmo-hlr_10.42.42.2(pid=28765): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28765)] 10:53:38.293704 run osmo-hlr_10.42.42.2(pid=28765): stdout: | (launched: 2022-12-09_10:53:35.061251) 10:53:38.346590 run osmo-hlr_10.42.42.2(pid=28765): stderr: | 20221209105335262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105335262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105335262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105335263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105335263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105335263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105335274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105335283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105335283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105335283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:38.420173 run osmo-msc_10.42.42.6(pid=28771): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28771)] 10:53:38.471138 run osmo-msc_10.42.42.6(pid=28771): stdout: | (launched: 2022-12-09_10:53:37.273279) 10:53:38.523695 run osmo-msc_10.42.42.6(pid=28771): stderr: | 20221209105337595 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105337595 DLGLOBAL DEBUG validating counter group 0x7fd30089ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105337595 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105337595 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105337595 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105337595 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105337597 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105337598 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105337598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105337598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:38.576592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28764): Terminating (SIGTERM) 10:53:38.619214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28767): Terminating (SIGTERM) 10:53:38.661906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28770): Terminating (SIGTERM) 10:53:38.704912 --- ParallelTerminationStrategy: PID 28764 died... 10:53:38.725356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28764): Terminated: ok {rc=0} 10:53:38.772705 --- ParallelTerminationStrategy: PID 28767 died... 10:53:38.792559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28767): Terminated: ok {rc=0} 10:53:38.839454 --- ParallelTerminationStrategy: PID 28770 died... 10:53:38.859209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28770): Terminated: ok {rc=0} 10:53:38.949512 bus /sierra_3: Setting Powered False 10:53:40.050465 bus /sierra_3: Setting Powered False 10:53:41.168054 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 10:53:42.253021 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:42.264556 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:53:42.305532 tst emergency_preemptive_call.py: using LAC 20967 10:53:42.423632 tst emergency_preemptive_call.py: using RAC 57 10:53:42.544176 tst emergency_preemptive_call.py: using CellId 20967 10:53:42.665226 tst emergency_preemptive_call.py: using BVCI 20968 10:53:42.775116 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:42.785997 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:42.796688 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:42.807384 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:42.818051 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:42.828774 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:42.946532 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:43.065099 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:43.183936 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:43.299905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:43.803310 run create_hlr_db(pid=28773): Launched 10:53:43.928443 bus /sierra_2: Setting Powered False 10:53:44.992720 run create_hlr_db(pid=28773): Terminated: ok {rc=0} 10:53:45.425092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28775): Launched 10:53:45.727859 run osmo-hlr_10.42.42.2(pid=28776): Launched 10:53:45.874124 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:46.465778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28778): Launched 10:53:46.806277 run osmo-stp_10.42.42.5(pid=28779): Launched 10:53:47.065089 tst emergency_preemptive_call.py: using MSISDN 7167 10:53:47.304250 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:47.888137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28781): Launched 10:53:48.212643 run osmo-msc_10.42.42.6(pid=28782): Launched 10:53:48.394660 run osmo-stp_10.42.42.5(pid=28779): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28779)] 10:53:48.531034 run osmo-stp_10.42.42.5(pid=28779): stdout: | (launched: 2022-12-09_10:53:46.745982) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:48.668263 run osmo-stp_10.42.42.5(pid=28779): stderr: | 20221209105347044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105347044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105347045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105347045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105347045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105347046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105347046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:48.804731 run osmo-stp_10.42.42.5(pid=28779): stdout: | (launched: 2022-12-09_10:53:46.745982) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:48.933469 run osmo-stp_10.42.42.5(pid=28779): stderr: | 20221209105347044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105347044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105347045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105347045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105347045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105347046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105347046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:49.087071 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28779): Process ended prematurely: osmo-stp_10.42.42.5(pid=28779) [trial-2358↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28779)] [trial-2358↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 10:53:49.096280 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 10:53:49.125382 run osmo-hlr_10.42.42.2(pid=28776): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28776)] 10:53:49.176454 run osmo-hlr_10.42.42.2(pid=28776): stdout: | (launched: 2022-12-09_10:53:45.671654) 10:53:49.229407 run osmo-hlr_10.42.42.2(pid=28776): stderr: | 20221209105345852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105345852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105345852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105345852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105345852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105345852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105345865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105345881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105345881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105345881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:49.303114 run osmo-msc_10.42.42.6(pid=28782): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28782)] 10:53:49.354275 run osmo-msc_10.42.42.6(pid=28782): stdout: | (launched: 2022-12-09_10:53:48.153291) 10:53:49.407046 run osmo-msc_10.42.42.6(pid=28782): stderr: | 20221209105348474 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105348474 DLGLOBAL DEBUG validating counter group 0x7f27fcac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105348474 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105348474 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105348474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105348475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105348476 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105348477 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105348477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105348477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:49.460380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28775): Terminating (SIGTERM) 10:53:49.503341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28778): Terminating (SIGTERM) 10:53:49.546402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28781): Terminating (SIGTERM) 10:53:49.589563 --- ParallelTerminationStrategy: PID 28775 died... 10:53:49.609894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28775): Terminated: ok {rc=0} 10:53:49.657269 --- ParallelTerminationStrategy: PID 28778 died... 10:53:49.677554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28778): Terminated: ok {rc=0} 10:53:49.724728 --- ParallelTerminationStrategy: PID 28781 died... 10:53:49.744586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28781): Terminated: ok {rc=0} 10:53:49.834441 bus /sierra_9: Setting Powered False 10:53:50.935662 bus /sierra_9: Setting Powered False 10:53:52.054575 bus /sierra_8: Setting Powered False 10:53:53.155771 bus /sierra_8: Setting Powered False 10:53:54.272442 bus /sierra_3: Setting Powered False 10:53:55.372402 bus /sierra_3: Setting Powered False 10:53:56.490122 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-1900 --------------------------------------------------------------------- 10:53:57.763328 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:57.768571 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:53:57.792195 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 10:53:57.830261 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 10:53:57.915876 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:53:57.939200 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 10:53:57.976812 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 10:53:58.568938 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 10:53:58.618894 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:58.629605 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:53:58.668400 tst cs_paging_gprs_active.py: using LAC 20968 10:53:58.795134 tst cs_paging_gprs_active.py: using RAC 58 10:53:58.915630 tst cs_paging_gprs_active.py: using CellId 20968 10:53:59.036278 tst cs_paging_gprs_active.py: using BVCI 20969 10:53:59.147227 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.157973 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.168428 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.179057 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.189721 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.200129 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.210964 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.221742 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:53:59.232207 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:59.351099 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:53:59.468152 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:53:59.673113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:59.980739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28787): Launched 10:54:00.249745 run iperf3-srv_10.42.42.10(pid=28788): Launched 10:54:00.368330 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:54:00.575568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:00.905780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28789): Launched 10:54:01.195445 run iperf3-srv_10.42.42.10(pid=28790): Launched 10:54:01.337752 tst cs_paging_gprs_active.py:38: start network... 10:54:01.567413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:02.117810 run create_hlr_db(pid=28791): Launched 10:54:02.283604 bus /sierra_2: Setting Powered False 10:54:03.344579 run create_hlr_db(pid=28791): Terminated: ok {rc=0} 10:54:03.773611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28793): Launched 10:54:04.084268 run osmo-hlr_10.42.42.2(pid=28794): Launched 10:54:04.201623 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:04.748781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28796): Launched 10:54:05.058820 run osmo-stp_10.42.42.5(pid=28797): Launched 10:54:05.175434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:05.708422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28799): Launched 10:54:05.826174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:06.087623 run patchelf(pid=28800): Launched 10:54:06.259030 run osmo-stp_10.42.42.5(pid=28797): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28797)] 10:54:06.388752 run osmo-stp_10.42.42.5(pid=28797): stdout: | (launched: 2022-12-09_10:54:05.000817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:06.519591 run osmo-stp_10.42.42.5(pid=28797): stderr: | 20221209105405174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105405174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105405174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105405175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105405175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105405175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105405175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:06.651705 run osmo-stp_10.42.42.5(pid=28797): stdout: | (launched: 2022-12-09_10:54:05.000817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:06.777554 run osmo-stp_10.42.42.5(pid=28797): stderr: | 20221209105405174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105405174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105405174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105405175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105405175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105405175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105405175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:06.926684 run patchelf(pid=28800): Terminating (SIGINT) 10:54:07.099073 run patchelf(pid=28800): Terminated: ok {rc=0} 10:54:07.223089 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28797): Process ended prematurely: osmo-stp_10.42.42.5(pid=28797) [trial-2358↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28797)] [trial-2358↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 10:54:07.232540 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:54:07.260297 run osmo-hlr_10.42.42.2(pid=28794): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28794)] 10:54:07.308312 run osmo-hlr_10.42.42.2(pid=28794): stdout: | (launched: 2022-12-09_10:54:04.026529) 10:54:07.358048 run osmo-hlr_10.42.42.2(pid=28794): stderr: | 20221209105404204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105404204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105404204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105404204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105404204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105404204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105404216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105404227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105404227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105404227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:07.408304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28787): Terminating (SIGTERM) 10:54:07.448502 run iperf3-srv_10.42.42.10(pid=28788): Terminating (SIGTERM) 10:54:07.489531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28789): Terminating (SIGTERM) 10:54:07.530029 run iperf3-srv_10.42.42.10(pid=28790): Terminating (SIGTERM) 10:54:07.570134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28793): Terminating (SIGTERM) 10:54:07.610425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28796): Terminating (SIGTERM) 10:54:07.650658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28799): Terminating (SIGTERM) 10:54:07.691167 --- ParallelTerminationStrategy: PID 28787 died... 10:54:07.710601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28787): Terminated: ok {rc=0} 10:54:07.755199 --- ParallelTerminationStrategy: PID 28788 died... 10:54:07.774091 run iperf3-srv_10.42.42.10(pid=28788): Terminated {rc=256} 10:54:07.818431 --- ParallelTerminationStrategy: PID 28789 died... 10:54:07.837351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28789): Terminated: ok {rc=0} 10:54:07.881554 --- ParallelTerminationStrategy: PID 28790 died... 10:54:07.900263 run iperf3-srv_10.42.42.10(pid=28790): Terminated {rc=256} 10:54:07.944374 --- ParallelTerminationStrategy: PID 28793 died... 10:54:07.963299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28793): Terminated: ok {rc=0} 10:54:08.008005 --- ParallelTerminationStrategy: PID 28796 died... 10:54:08.026955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28796): Terminated: ok {rc=0} 10:54:08.071185 --- ParallelTerminationStrategy: PID 28799 died... 10:54:08.090173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28799): Terminated: ok {rc=0} 10:54:08.175426 bus /gobi_0: Setting Powered False 10:54:09.274945 bus /gobi_0: Setting Powered False 10:54:10.393513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 10:54:11.538582 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:11.549911 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:54:11.597455 tst iperf3.py: using LAC 20969 10:54:11.718224 tst iperf3.py: using RAC 59 10:54:11.838427 tst iperf3.py: using CellId 20969 10:54:11.970095 tst iperf3.py: using BVCI 20970 10:54:12.090176 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.101661 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.112883 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.124880 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.136415 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.147870 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.159655 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.171169 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:12.183140 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:12.306268 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:54:12.526948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:12.858993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28801): Launched 10:54:13.146944 run iperf3-srv_10.42.42.10(pid=28802): Launched 10:54:13.271333 tst iperf3.py:8: start network... 10:54:13.490910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:14.000781 run create_hlr_db(pid=28803): Launched 10:54:14.127669 bus /gobi_6: Setting Powered False 10:54:15.192261 run create_hlr_db(pid=28803): Terminated: ok {rc=0} 10:54:15.631043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28806): Launched 10:54:15.946841 run osmo-hlr_10.42.42.2(pid=28807): Launched 10:54:16.238397 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:16.898732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28809): Launched 10:54:17.261527 run osmo-stp_10.42.42.5(pid=28810): Launched 10:54:17.387589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:17.953228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28812): Launched 10:54:18.077890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:18.353505 run patchelf(pid=28813): Launched 10:54:18.535460 run osmo-stp_10.42.42.5(pid=28810): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28810)] 10:54:18.673442 run osmo-stp_10.42.42.5(pid=28810): stdout: | (launched: 2022-12-09_10:54:17.201739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:18.813236 run osmo-stp_10.42.42.5(pid=28810): stderr: | 20221209105417386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105417386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105417387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105417387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105417388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105417388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105417388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:18.952258 run osmo-stp_10.42.42.5(pid=28810): stdout: | (launched: 2022-12-09_10:54:17.201739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:19.086323 run osmo-stp_10.42.42.5(pid=28810): stderr: | 20221209105417386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105417386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105417387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105417387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105417388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105417388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105417388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:19.245447 run patchelf(pid=28813): Terminating (SIGINT) 10:54:19.428288 run patchelf(pid=28813): Terminated: ok {rc=0} 10:54:19.560395 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28810): Process ended prematurely: osmo-stp_10.42.42.5(pid=28810) [trial-2358↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28810)] [trial-2358↪gprs:nanobts+band-1900↪iperf3.py:8] 10:54:19.571076 tst iperf3.py:8: Test FAILED (8.1 sec) 10:54:19.601049 run osmo-hlr_10.42.42.2(pid=28807): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28807)] 10:54:19.652035 run osmo-hlr_10.42.42.2(pid=28807): stdout: | (launched: 2022-12-09_10:54:15.883110) 10:54:19.705514 run osmo-hlr_10.42.42.2(pid=28807): stderr: | 20221209105416195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105416195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105416195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105416195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105416195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105416195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105416214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105416223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105416223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105416223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:19.759313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28801): Terminating (SIGTERM) 10:54:19.802073 run iperf3-srv_10.42.42.10(pid=28802): Terminating (SIGTERM) 10:54:19.844657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28806): Terminating (SIGTERM) 10:54:19.887595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28809): Terminating (SIGTERM) 10:54:19.930369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28812): Terminating (SIGTERM) 10:54:19.973692 --- ParallelTerminationStrategy: PID 28801 died... 10:54:19.994053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28801): Terminated: ok {rc=0} 10:54:20.041920 --- ParallelTerminationStrategy: PID 28802 died... 10:54:20.061845 run iperf3-srv_10.42.42.10(pid=28802): Terminated {rc=256} 10:54:20.109405 --- ParallelTerminationStrategy: PID 28806 died... 10:54:20.129289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28806): Terminated: ok {rc=0} 10:54:20.176715 --- ParallelTerminationStrategy: PID 28809 died... 10:54:20.196772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28809): Terminated: ok {rc=0} 10:54:20.244672 --- ParallelTerminationStrategy: PID 28812 died... 10:54:20.264609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28812): Terminated: ok {rc=0} 10:54:20.354592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 10:54:21.506930 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:21.519282 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:54:21.561200 tst iperf3m4.py: using LAC 20970 10:54:21.689389 tst iperf3m4.py: using RAC 60 10:54:21.823282 tst iperf3m4.py: using CellId 20970 10:54:21.950837 tst iperf3m4.py: using BVCI 20971 10:54:22.068827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.080135 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.091218 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.102741 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.114105 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.125386 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.136886 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.148156 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:22.159640 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:22.278245 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:22.400819 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:22.516768 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:22.636487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:54:22.856217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:23.183245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28814): Launched 10:54:23.466242 run iperf3-srv_10.42.42.10(pid=28815): Launched 10:54:23.589291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:54:23.806814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:24.132351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28816): Launched 10:54:24.414310 run iperf3-srv_10.42.42.10(pid=28817): Launched 10:54:24.535997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:54:24.753844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:25.078795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28818): Launched 10:54:25.361400 run iperf3-srv_10.42.42.10(pid=28819): Launched 10:54:25.483588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:54:25.702119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:26.029308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28820): Launched 10:54:26.310736 run iperf3-srv_10.42.42.10(pid=28821): Launched 10:54:26.432579 tst iperf3m4.py:8: start network... 10:54:26.649790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:27.152301 run create_hlr_db(pid=28822): Launched 10:54:27.275782 bus /gobi_6: Setting Powered False 10:54:28.339208 run create_hlr_db(pid=28822): Terminated: ok {rc=0} 10:54:28.769218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28824): Launched 10:54:29.071059 run osmo-hlr_10.42.42.2(pid=28825): Launched 10:54:29.185775 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:29.711668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28827): Launched 10:54:30.012534 run osmo-stp_10.42.42.5(pid=28828): Launched 10:54:30.127765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:30.646887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28830): Launched 10:54:30.763030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:31.038804 run patchelf(pid=28831): Launched 10:54:31.243965 run osmo-stp_10.42.42.5(pid=28828): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28828)] 10:54:31.387038 run osmo-stp_10.42.42.5(pid=28828): stdout: | (launched: 2022-12-09_10:54:29.957138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:31.531318 run osmo-stp_10.42.42.5(pid=28828): stderr: | 20221209105430125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105430125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105430126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105430126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105430126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105430126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105430127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:31.675731 run osmo-stp_10.42.42.5(pid=28828): stdout: | (launched: 2022-12-09_10:54:29.957138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:31.815104 run osmo-stp_10.42.42.5(pid=28828): stderr: | 20221209105430125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105430125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105430126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105430126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105430126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105430126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105430127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:31.980095 run patchelf(pid=28831): Terminating (SIGINT) 10:54:32.168469 run patchelf(pid=28831): Terminated: ok {rc=0} 10:54:32.304048 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28828): Process ended prematurely: osmo-stp_10.42.42.5(pid=28828) [trial-2358↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28828)] [trial-2358↪gprs:nanobts+band-1900↪iperf3m4.py:8] 10:54:32.314582 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:54:32.344635 run osmo-hlr_10.42.42.2(pid=28825): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28825)] 10:54:32.396122 run osmo-hlr_10.42.42.2(pid=28825): stdout: | (launched: 2022-12-09_10:54:29.015335) 10:54:32.448825 run osmo-hlr_10.42.42.2(pid=28825): stderr: | 20221209105429190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105429190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105429190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105429190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105429190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105429190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105429203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105429213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105429213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105429214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:32.502076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28814): Terminating (SIGTERM) 10:54:32.544704 run iperf3-srv_10.42.42.10(pid=28815): Terminating (SIGTERM) 10:54:32.587788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28816): Terminating (SIGTERM) 10:54:32.630719 run iperf3-srv_10.42.42.10(pid=28817): Terminating (SIGTERM) 10:54:32.673201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28818): Terminating (SIGTERM) 10:54:32.715882 run iperf3-srv_10.42.42.10(pid=28819): Terminating (SIGTERM) 10:54:32.758327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28820): Terminating (SIGTERM) 10:54:32.800872 run iperf3-srv_10.42.42.10(pid=28821): Terminating (SIGTERM) 10:54:32.843324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28824): Terminating (SIGTERM) 10:54:32.886189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28827): Terminating (SIGTERM) 10:54:32.928733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28830): Terminating (SIGTERM) 10:54:32.971440 --- ParallelTerminationStrategy: PID 28814 died... 10:54:32.991574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28814): Terminated: ok {rc=0} 10:54:33.039196 --- ParallelTerminationStrategy: PID 28815 died... 10:54:33.059097 run iperf3-srv_10.42.42.10(pid=28815): Terminated {rc=256} 10:54:33.106515 --- ParallelTerminationStrategy: PID 28816 died... 10:54:33.126582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28816): Terminated: ok {rc=0} 10:54:33.174248 --- ParallelTerminationStrategy: PID 28817 died... 10:54:33.194252 run iperf3-srv_10.42.42.10(pid=28817): Terminated {rc=256} 10:54:33.241615 --- ParallelTerminationStrategy: PID 28818 died... 10:54:33.261675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28818): Terminated: ok {rc=0} 10:54:33.309061 --- ParallelTerminationStrategy: PID 28819 died... 10:54:33.329140 run iperf3-srv_10.42.42.10(pid=28819): Terminated {rc=256} 10:54:33.376506 --- ParallelTerminationStrategy: PID 28820 died... 10:54:33.396685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28820): Terminated: ok {rc=0} 10:54:33.443952 --- ParallelTerminationStrategy: PID 28821 died... 10:54:33.463851 run iperf3-srv_10.42.42.10(pid=28821): Terminated {rc=256} 10:54:33.511259 --- ParallelTerminationStrategy: PID 28824 died... 10:54:33.531276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28824): Terminated: ok {rc=0} 10:54:33.578525 --- ParallelTerminationStrategy: PID 28827 died... 10:54:33.598839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28827): Terminated: ok {rc=0} 10:54:33.646170 --- ParallelTerminationStrategy: PID 28830 died... 10:54:33.666165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28830): Terminated: ok {rc=0} 10:54:33.755807 bus /gobi_4: Setting Powered False 10:54:34.855456 bus /gobi_4: Setting Powered False 10:54:35.972810 bus /gobi_1: Setting Powered False 10:54:37.071391 bus /gobi_1: Setting Powered False 10:54:38.191104 bus /gobi_0: Setting Powered False 10:54:39.290251 bus /gobi_0: Setting Powered False 10:54:40.405378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 10:54:41.509223 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:41.520464 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:54:41.560135 tst ping.py: using LAC 20971 10:54:41.678564 tst ping.py: using RAC 61 10:54:41.798669 tst ping.py: using CellId 20971 10:54:41.917182 tst ping.py: using BVCI 20972 10:54:42.024403 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.035106 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.045713 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.056204 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.066688 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.077206 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.087695 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:42.098190 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:42.211468 tst ping.py:19: start network... 10:54:42.407573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:42.865990 run create_hlr_db(pid=28832): Launched 10:54:42.987626 bus /gobi_6: Setting Powered False 10:54:44.046817 run create_hlr_db(pid=28832): Terminated: ok {rc=0} 10:54:44.480468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Launched 10:54:44.798094 run osmo-hlr_10.42.42.2(pid=28835): Launched 10:54:44.918792 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:45.469949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Launched 10:54:45.789319 run osmo-stp_10.42.42.5(pid=28838): Launched 10:54:45.950872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:46.593969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28840): Launched 10:54:46.728936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:47.006120 run patchelf(pid=28841): Launched 10:54:47.219994 run osmo-stp_10.42.42.5(pid=28838): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] 10:54:47.360165 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-09_10:54:45.730725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:47.497786 run osmo-stp_10.42.42.5(pid=28838): stderr: | 20221209105445999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105445999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105446000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105446000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105446001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105446001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105446001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:47.634635 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-09_10:54:45.730725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:47.766021 run osmo-stp_10.42.42.5(pid=28838): stderr: | 20221209105445999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105445999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105446000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105446000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105446001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105446001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105446001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:47.921029 run patchelf(pid=28841): Terminating (SIGINT) 10:54:48.100009 run patchelf(pid=28841): Terminated: ok {rc=0} 10:54:48.229241 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2358↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] [trial-2358↪gprs:nanobts+band-1900↪ping.py:22] 10:54:48.239042 tst ping.py:22: Test FAILED (6.7 sec) 10:54:48.268195 run osmo-hlr_10.42.42.2(pid=28835): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28835)] 10:54:48.319002 run osmo-hlr_10.42.42.2(pid=28835): stdout: | (launched: 2022-12-09_10:54:44.739720) 10:54:48.371882 run osmo-hlr_10.42.42.2(pid=28835): stderr: | 20221209105444935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105444935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105444935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105444935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105444935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105444935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105444950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105444958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105444958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105444958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:48.424674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminating (SIGTERM) 10:54:48.467302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminating (SIGTERM) 10:54:48.509720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28840): Terminating (SIGTERM) 10:54:48.552076 --- ParallelTerminationStrategy: PID 28834 died... 10:54:48.572496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminated: ok {rc=0} 10:54:48.619717 --- ParallelTerminationStrategy: PID 28837 died... 10:54:48.639551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminated: ok {rc=0} 10:54:48.686556 --- ParallelTerminationStrategy: PID 28840 died... 10:54:48.706598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28840): Terminated: ok {rc=0} 10:54:48.795296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 10:54:49.880836 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:49.892712 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:54:49.936364 tst ping_idle_ping.py: using LAC 20972 10:54:50.052653 tst ping_idle_ping.py: using RAC 62 10:54:50.170053 tst ping_idle_ping.py: using CellId 20972 10:54:50.289526 tst ping_idle_ping.py: using BVCI 20973 10:54:50.397546 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.408236 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.419017 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.429973 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.440522 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.451248 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.462010 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:54:50.472855 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:54:50.588477 tst ping_idle_ping.py:24: start network... 10:54:50.803220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:51.298829 run create_hlr_db(pid=28842): Launched 10:54:51.423660 bus /gobi_6: Setting Powered False 10:54:52.488050 run create_hlr_db(pid=28842): Terminated: ok {rc=0} 10:54:52.915491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28844): Launched 10:54:53.213573 run osmo-hlr_10.42.42.2(pid=28845): Launched 10:54:53.328234 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:53.843513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28847): Launched 10:54:54.141018 run osmo-stp_10.42.42.5(pid=28848): Launched 10:54:54.255201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:54.768173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28850): Launched 10:54:54.882336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:55.133676 run patchelf(pid=28851): Launched 10:54:55.300498 run osmo-stp_10.42.42.5(pid=28848): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28848)] 10:54:55.427364 run osmo-stp_10.42.42.5(pid=28848): stdout: | (launched: 2022-12-09_10:54:54.085809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:55.555263 run osmo-stp_10.42.42.5(pid=28848): stderr: | 20221209105454252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105454252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105454253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105454253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105454254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105454254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105454254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:55.683019 run osmo-stp_10.42.42.5(pid=28848): stdout: | (launched: 2022-12-09_10:54:54.085809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:55.805710 run osmo-stp_10.42.42.5(pid=28848): stderr: | 20221209105454252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105454252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105454253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105454253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105454254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105454254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105454254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:55.950899 run patchelf(pid=28851): Terminating (SIGINT) 10:54:56.118210 run patchelf(pid=28851): Terminated: ok {rc=0} 10:54:56.238876 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28848): Process ended prematurely: osmo-stp_10.42.42.5(pid=28848) [trial-2358↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28848)] [trial-2358↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 10:54:56.247821 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:54:56.274811 run osmo-hlr_10.42.42.2(pid=28845): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28845)] 10:54:56.322348 run osmo-hlr_10.42.42.2(pid=28845): stdout: | (launched: 2022-12-09_10:54:53.158351) 10:54:56.371357 run osmo-hlr_10.42.42.2(pid=28845): stderr: | 20221209105453329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105453329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105453329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105453329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105453329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105453329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105453342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105453353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105453353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105453353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:56.421386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28844): Terminating (SIGTERM) 10:54:56.461401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28847): Terminating (SIGTERM) 10:54:56.501134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28850): Terminating (SIGTERM) 10:54:56.541183 --- ParallelTerminationStrategy: PID 28844 died... 10:54:56.560285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28844): Terminated: ok {rc=0} 10:54:56.604228 --- ParallelTerminationStrategy: PID 28847 died... 10:54:56.623105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28847): Terminated: ok {rc=0} 10:54:56.666635 --- ParallelTerminationStrategy: PID 28850 died... 10:54:56.685392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28850): Terminated: ok {rc=0} 10:54:56.770304 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 10:54:58.072128 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:58.078954 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:54:58.105222 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:54:58.145807 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:54:58.235985 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:54:58.261936 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:54:58.302101 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:54:58.893063 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:54:58.946169 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:58.957735 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:54:59.000624 tst cs_paging_gprs_active.py: using LAC 20973 10:54:59.129350 tst cs_paging_gprs_active.py: using RAC 63 10:54:59.257419 tst cs_paging_gprs_active.py: using CellId 20973 10:54:59.384934 tst cs_paging_gprs_active.py: using BVCI 20974 10:54:59.504324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.516079 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.527262 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.539149 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.550859 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.562775 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.575423 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.586609 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:59.598565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:54:59.716784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:54:59.835137 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:55:00.054059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:00.378888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28856): Launched 10:55:00.660078 run iperf3-srv_10.42.42.10(pid=28857): Launched 10:55:00.782866 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:55:01.011093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:01.353298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28861): Launched 10:55:01.705619 run iperf3-srv_10.42.42.10(pid=28862): Launched 10:55:01.879241 tst cs_paging_gprs_active.py:38: start network... 10:55:02.125396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:02.644454 run create_hlr_db(pid=28863): Launched 10:55:02.770161 bus /gobi_6: Setting Powered False 10:55:03.834135 run create_hlr_db(pid=28863): Terminated: ok {rc=0} 10:55:04.266043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28865): Launched 10:55:04.569372 run osmo-hlr_10.42.42.2(pid=28866): Launched 10:55:04.685817 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:05.206024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28868): Launched 10:55:05.507145 run osmo-stp_10.42.42.5(pid=28869): Launched 10:55:05.622981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:06.140549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28871): Launched 10:55:06.255837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:06.511266 run patchelf(pid=28872): Launched 10:55:06.680304 run osmo-stp_10.42.42.5(pid=28869): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28869)] 10:55:06.807700 run osmo-stp_10.42.42.5(pid=28869): stdout: | (launched: 2022-12-09_10:55:05.451454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:06.936311 run osmo-stp_10.42.42.5(pid=28869): stderr: | 20221209105505618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105505618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105505618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105505619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105505619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105505619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105505619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:07.065685 run osmo-stp_10.42.42.5(pid=28869): stdout: | (launched: 2022-12-09_10:55:05.451454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:07.189396 run osmo-stp_10.42.42.5(pid=28869): stderr: | 20221209105505618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105505618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105505618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105505619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105505619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105505619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105505619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:07.335692 run patchelf(pid=28872): Terminating (SIGINT) 10:55:07.504033 run patchelf(pid=28872): Terminated: ok {rc=0} 10:55:07.625420 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28869): Process ended prematurely: osmo-stp_10.42.42.5(pid=28869) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28869)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:55:07.634980 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:55:07.662286 run osmo-hlr_10.42.42.2(pid=28866): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28866)] 10:55:07.710008 run osmo-hlr_10.42.42.2(pid=28866): stdout: | (launched: 2022-12-09_10:55:04.513175) 10:55:07.759332 run osmo-hlr_10.42.42.2(pid=28866): stderr: | 20221209105504686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105504686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105504687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105504687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105504687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105504687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105504699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105504708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105504708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105504708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:07.809351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28856): Terminating (SIGTERM) 10:55:07.849395 run iperf3-srv_10.42.42.10(pid=28857): Terminating (SIGTERM) 10:55:07.889196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28861): Terminating (SIGTERM) 10:55:07.929542 run iperf3-srv_10.42.42.10(pid=28862): Terminating (SIGTERM) 10:55:07.969220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28865): Terminating (SIGTERM) 10:55:08.009076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28868): Terminating (SIGTERM) 10:55:08.048730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28871): Terminating (SIGTERM) 10:55:08.088847 --- ParallelTerminationStrategy: PID 28856 died... 10:55:08.108121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28856): Terminated: ok {rc=0} 10:55:08.152677 --- ParallelTerminationStrategy: PID 28857 died... 10:55:08.171290 run iperf3-srv_10.42.42.10(pid=28857): Terminated {rc=256} 10:55:08.215492 --- ParallelTerminationStrategy: PID 28861 died... 10:55:08.234147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28861): Terminated: ok {rc=0} 10:55:08.277930 --- ParallelTerminationStrategy: PID 28862 died... 10:55:08.296441 run iperf3-srv_10.42.42.10(pid=28862): Terminated {rc=256} 10:55:08.340180 --- ParallelTerminationStrategy: PID 28865 died... 10:55:08.358868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28865): Terminated: ok {rc=0} 10:55:08.402569 --- ParallelTerminationStrategy: PID 28868 died... 10:55:08.421226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28868): Terminated: ok {rc=0} 10:55:08.465207 --- ParallelTerminationStrategy: PID 28871 died... 10:55:08.484022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28871): Terminated: ok {rc=0} 10:55:08.568140 bus /gobi_0: Setting Powered False 10:55:09.667020 bus /gobi_0: Setting Powered False 10:55:10.786224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:55:11.931886 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:11.943427 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:11.986382 tst iperf3.py: using LAC 20974 10:55:12.105937 tst iperf3.py: using RAC 64 10:55:12.224297 tst iperf3.py: using CellId 20974 10:55:12.348195 tst iperf3.py: using BVCI 20975 10:55:12.459633 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.470613 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.481360 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.491976 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.502575 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.513132 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.523842 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.534385 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:12.545080 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:12.660866 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:55:12.861770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:13.165105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28873): Launched 10:55:13.427295 run iperf3-srv_10.42.42.10(pid=28874): Launched 10:55:13.540201 tst iperf3.py:8: start network... 10:55:13.741015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:14.208854 run create_hlr_db(pid=28875): Launched 10:55:14.335572 bus /gobi_6: Setting Powered False 10:55:15.398862 run create_hlr_db(pid=28875): Terminated: ok {rc=0} 10:55:15.857932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Launched 10:55:16.193650 run osmo-hlr_10.42.42.2(pid=28878): Launched 10:55:16.456477 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:17.093751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Launched 10:55:17.432644 run osmo-stp_10.42.42.5(pid=28881): Launched 10:55:17.560141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:18.119570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28883): Launched 10:55:18.243144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:18.515981 run patchelf(pid=28884): Launched 10:55:18.695517 run osmo-stp_10.42.42.5(pid=28881): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] 10:55:18.833151 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-09_10:55:17.373134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:18.971483 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221209105517563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105517563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105517563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105517563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105517564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105517564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105517564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:19.110267 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-09_10:55:17.373134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:19.243541 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221209105517563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105517563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105517563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105517563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105517564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105517564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105517564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:19.401107 run patchelf(pid=28884): Terminating (SIGINT) 10:55:19.582358 run patchelf(pid=28884): Terminated: ok {rc=0} 10:55:19.713376 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 10:55:19.723912 tst iperf3.py:8: Test FAILED (7.8 sec) 10:55:19.753337 run osmo-hlr_10.42.42.2(pid=28878): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28878)] 10:55:19.804002 run osmo-hlr_10.42.42.2(pid=28878): stdout: | (launched: 2022-12-09_10:55:16.131662) 10:55:19.856271 run osmo-hlr_10.42.42.2(pid=28878): stderr: | 20221209105516372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105516372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105516372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105516372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105516372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105516372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105516394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105516411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105516411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105516411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:19.908897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28873): Terminating (SIGTERM) 10:55:19.950995 run iperf3-srv_10.42.42.10(pid=28874): Terminating (SIGTERM) 10:55:19.994591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminating (SIGTERM) 10:55:20.037171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminating (SIGTERM) 10:55:20.079605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28883): Terminating (SIGTERM) 10:55:20.122263 --- ParallelTerminationStrategy: PID 28873 died... 10:55:20.142217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28873): Terminated: ok {rc=0} 10:55:20.188866 --- ParallelTerminationStrategy: PID 28874 died... 10:55:20.208853 run iperf3-srv_10.42.42.10(pid=28874): Terminated {rc=256} 10:55:20.255334 --- ParallelTerminationStrategy: PID 28877 died... 10:55:20.274857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminated: ok {rc=0} 10:55:20.321432 --- ParallelTerminationStrategy: PID 28880 died... 10:55:20.340916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminated: ok {rc=0} 10:55:20.387438 --- ParallelTerminationStrategy: PID 28883 died... 10:55:20.406932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28883): Terminated: ok {rc=0} 10:55:20.495469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:55:21.646361 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:21.658389 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:21.700555 tst iperf3m4.py: using LAC 20975 10:55:21.829122 tst iperf3m4.py: using RAC 65 10:55:21.955997 tst iperf3m4.py: using CellId 20975 10:55:22.084627 tst iperf3m4.py: using BVCI 20976 10:55:22.202147 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.213680 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.224753 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.236329 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.248064 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.259540 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.271182 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.282979 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:22.294595 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:22.414334 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:22.532516 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:22.650922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:22.768761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:55:22.972048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:23.276477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28885): Launched 10:55:23.540206 run iperf3-srv_10.42.42.10(pid=28886): Launched 10:55:23.653787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:55:23.855424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:24.157616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28887): Launched 10:55:24.422551 run iperf3-srv_10.42.42.10(pid=28888): Launched 10:55:24.536361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:55:24.737859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:25.041683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Launched 10:55:25.307829 run iperf3-srv_10.42.42.10(pid=28890): Launched 10:55:25.421573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:55:25.622460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:25.924824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28891): Launched 10:55:26.188009 run iperf3-srv_10.42.42.10(pid=28892): Launched 10:55:26.301248 tst iperf3m4.py:8: start network... 10:55:26.501780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:26.967671 run create_hlr_db(pid=28893): Launched 10:55:27.092054 bus /gobi_6: Setting Powered False 10:55:28.152880 run create_hlr_db(pid=28893): Terminated: ok {rc=0} 10:55:28.593385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Launched 10:55:28.918893 run osmo-hlr_10.42.42.2(pid=28896): Launched 10:55:29.042175 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:29.607280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Launched 10:55:29.931483 run osmo-stp_10.42.42.5(pid=28899): Launched 10:55:30.056097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:30.614104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Launched 10:55:30.739615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:31.042791 run patchelf(pid=28902): Launched 10:55:31.229717 run osmo-stp_10.42.42.5(pid=28899): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] 10:55:31.362359 run osmo-stp_10.42.42.5(pid=28899): stdout: | (launched: 2022-12-09_10:55:29.872524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:31.493655 run osmo-stp_10.42.42.5(pid=28899): stderr: | 20221209105530058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105530059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105530059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105530059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105530060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105530060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105530060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:31.627371 run osmo-stp_10.42.42.5(pid=28899): stdout: | (launched: 2022-12-09_10:55:29.872524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:31.755294 run osmo-stp_10.42.42.5(pid=28899): stderr: | 20221209105530058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105530059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105530059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105530059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105530060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105530060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105530060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:31.906858 run patchelf(pid=28902): Terminating (SIGINT) 10:55:32.079467 run patchelf(pid=28902): Terminated: ok {rc=0} 10:55:32.205271 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28899): Process ended prematurely: osmo-stp_10.42.42.5(pid=28899) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 10:55:32.215859 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:55:32.244244 run osmo-hlr_10.42.42.2(pid=28896): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28896)] 10:55:32.294276 run osmo-hlr_10.42.42.2(pid=28896): stdout: | (launched: 2022-12-09_10:55:28.859947) 10:55:32.345773 run osmo-hlr_10.42.42.2(pid=28896): stderr: | 20221209105529051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105529051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105529051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105529051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105529051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105529051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105529063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105529074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105529075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105529075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:32.396000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28885): Terminating (SIGTERM) 10:55:32.435892 run iperf3-srv_10.42.42.10(pid=28886): Terminating (SIGTERM) 10:55:32.475810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28887): Terminating (SIGTERM) 10:55:32.516020 run iperf3-srv_10.42.42.10(pid=28888): Terminating (SIGTERM) 10:55:32.555717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Terminating (SIGTERM) 10:55:32.595590 run iperf3-srv_10.42.42.10(pid=28890): Terminating (SIGTERM) 10:55:32.635233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28891): Terminating (SIGTERM) 10:55:32.675071 run iperf3-srv_10.42.42.10(pid=28892): Terminating (SIGTERM) 10:55:32.714569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Terminating (SIGTERM) 10:55:32.754171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Terminating (SIGTERM) 10:55:32.793754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Terminating (SIGTERM) 10:55:32.833841 --- ParallelTerminationStrategy: PID 28885 died... 10:55:32.852818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28885): Terminated: ok {rc=0} 10:55:32.896942 --- ParallelTerminationStrategy: PID 28886 died... 10:55:32.915979 run iperf3-srv_10.42.42.10(pid=28886): Terminated {rc=256} 10:55:32.959820 --- ParallelTerminationStrategy: PID 28887 died... 10:55:32.978557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28887): Terminated: ok {rc=0} 10:55:33.022417 --- ParallelTerminationStrategy: PID 28888 died... 10:55:33.041101 run iperf3-srv_10.42.42.10(pid=28888): Terminated {rc=256} 10:55:33.085278 --- ParallelTerminationStrategy: PID 28889 died... 10:55:33.103927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Terminated: ok {rc=0} 10:55:33.147663 --- ParallelTerminationStrategy: PID 28890 died... 10:55:33.166275 run iperf3-srv_10.42.42.10(pid=28890): Terminated {rc=256} 10:55:33.210044 --- ParallelTerminationStrategy: PID 28891 died... 10:55:33.228919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28891): Terminated: ok {rc=0} 10:55:33.273927 --- ParallelTerminationStrategy: PID 28892 died... 10:55:33.292459 run iperf3-srv_10.42.42.10(pid=28892): Terminated {rc=256} 10:55:33.336212 --- ParallelTerminationStrategy: PID 28895 died... 10:55:33.354907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Terminated: ok {rc=0} 10:55:33.398813 --- ParallelTerminationStrategy: PID 28898 died... 10:55:33.417966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Terminated: ok {rc=0} 10:55:33.462014 --- ParallelTerminationStrategy: PID 28901 died... 10:55:33.480777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Terminated: ok {rc=0} 10:55:33.564996 bus /gobi_4: Setting Powered False 10:55:34.663400 bus /gobi_4: Setting Powered False 10:55:35.780400 bus /gobi_1: Setting Powered False 10:55:36.879358 bus /gobi_1: Setting Powered False 10:55:37.994916 bus /gobi_0: Setting Powered False 10:55:39.093192 bus /gobi_0: Setting Powered False 10:55:40.209851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 10:55:41.312749 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.325056 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:41.367358 tst ping.py: using LAC 20976 10:55:41.493278 tst ping.py: using RAC 66 10:55:41.619294 tst ping.py: using CellId 20976 10:55:41.742733 tst ping.py: using BVCI 20977 10:55:41.858463 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.869922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.881278 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.893512 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.905227 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.916750 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.929562 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:41.942419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:42.059290 tst ping.py:19: start network... 10:55:42.271810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:42.762279 run create_hlr_db(pid=28903): Launched 10:55:42.885220 bus /gobi_6: Setting Powered False 10:55:43.948547 run create_hlr_db(pid=28903): Terminated: ok {rc=0} 10:55:44.373046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28905): Launched 10:55:44.669689 run osmo-hlr_10.42.42.2(pid=28906): Launched 10:55:44.782650 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:45.308697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28908): Launched 10:55:45.604572 run osmo-stp_10.42.42.5(pid=28909): Launched 10:55:45.717357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:46.277974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28911): Launched 10:55:46.397242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:46.657714 run patchelf(pid=28912): Launched 10:55:46.849082 run osmo-stp_10.42.42.5(pid=28909): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28909)] 10:55:46.988456 run osmo-stp_10.42.42.5(pid=28909): stdout: | (launched: 2022-12-09_10:55:45.550121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:47.129445 run osmo-stp_10.42.42.5(pid=28909): stderr: | 20221209105545715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105545715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105545715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105545716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105545716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105545716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105545717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:47.267944 run osmo-stp_10.42.42.5(pid=28909): stdout: | (launched: 2022-12-09_10:55:45.550121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:47.399766 run osmo-stp_10.42.42.5(pid=28909): stderr: | 20221209105545715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105545715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105545715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105545716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105545716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105545716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105545717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:47.555337 run patchelf(pid=28912): Terminating (SIGINT) 10:55:47.734117 run patchelf(pid=28912): Terminated: ok {rc=0} 10:55:47.863968 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28909): Process ended prematurely: osmo-stp_10.42.42.5(pid=28909) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28909)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 10:55:47.873963 tst ping.py:22: Test FAILED (6.6 sec) 10:55:47.903336 run osmo-hlr_10.42.42.2(pid=28906): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28906)] 10:55:47.954459 run osmo-hlr_10.42.42.2(pid=28906): stdout: | (launched: 2022-12-09_10:55:44.614725) 10:55:48.007314 run osmo-hlr_10.42.42.2(pid=28906): stderr: | 20221209105544788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105544788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105544788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105544788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105544788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105544788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105544800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105544809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105544809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105544810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:48.060490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28905): Terminating (SIGTERM) 10:55:48.103241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28908): Terminating (SIGTERM) 10:55:48.146123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28911): Terminating (SIGTERM) 10:55:48.188875 --- ParallelTerminationStrategy: PID 28905 died... 10:55:48.209310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28905): Terminated: ok {rc=0} 10:55:48.256526 --- ParallelTerminationStrategy: PID 28908 died... 10:55:48.276431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28908): Terminated: ok {rc=0} 10:55:48.323787 --- ParallelTerminationStrategy: PID 28911 died... 10:55:48.343848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28911): Terminated: ok {rc=0} 10:55:48.433777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:55:49.521397 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:49.533619 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:49.576619 tst ping_idle_ping.py: using LAC 20977 10:55:49.702869 tst ping_idle_ping.py: using RAC 67 10:55:49.832400 tst ping_idle_ping.py: using CellId 20977 10:55:49.960127 tst ping_idle_ping.py: using BVCI 20978 10:55:50.076083 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.087570 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.098836 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.110417 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.121835 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.133209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.144785 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:50.156170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:50.273845 tst ping_idle_ping.py:24: start network... 10:55:50.471778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:50.940881 run create_hlr_db(pid=28913): Launched 10:55:51.063661 bus /gobi_6: Setting Powered False 10:55:52.123221 run create_hlr_db(pid=28913): Terminated: ok {rc=0} 10:55:52.538835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28915): Launched 10:55:52.835817 run osmo-hlr_10.42.42.2(pid=28916): Launched 10:55:52.948302 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:53.459184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28918): Launched 10:55:53.755848 run osmo-stp_10.42.42.5(pid=28919): Launched 10:55:53.869839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:54.383905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28921): Launched 10:55:54.497658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:54.749095 run patchelf(pid=28922): Launched 10:55:54.914889 run osmo-stp_10.42.42.5(pid=28919): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28919)] 10:55:55.040504 run osmo-stp_10.42.42.5(pid=28919): stdout: | (launched: 2022-12-09_10:55:53.701464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:55.167358 run osmo-stp_10.42.42.5(pid=28919): stderr: | 20221209105553868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105553868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105553868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105553869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105553869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105553869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105553869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:55.294233 run osmo-stp_10.42.42.5(pid=28919): stdout: | (launched: 2022-12-09_10:55:53.701464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:55.416454 run osmo-stp_10.42.42.5(pid=28919): stderr: | 20221209105553868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105553868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105553868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105553869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105553869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105553869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105553869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:55.560815 run patchelf(pid=28922): Terminating (SIGINT) 10:55:55.727173 run patchelf(pid=28922): Terminated: ok {rc=0} 10:55:55.847220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28919): Process ended prematurely: osmo-stp_10.42.42.5(pid=28919) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28919)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 10:55:55.855865 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:55:55.882700 run osmo-hlr_10.42.42.2(pid=28916): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28916)] 10:55:55.930048 run osmo-hlr_10.42.42.2(pid=28916): stdout: | (launched: 2022-12-09_10:55:52.780584) 10:55:55.978877 run osmo-hlr_10.42.42.2(pid=28916): stderr: | 20221209105552955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105552955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105552955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105552955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105552955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105552955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105552967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105552976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105552977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105552977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:56.028180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28915): Terminating (SIGTERM) 10:55:56.067717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28918): Terminating (SIGTERM) 10:55:56.107096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28921): Terminating (SIGTERM) 10:55:56.147016 --- ParallelTerminationStrategy: PID 28915 died... 10:55:56.166353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28915): Terminated: ok {rc=0} 10:55:56.210924 --- ParallelTerminationStrategy: PID 28918 died... 10:55:56.229586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28918): Terminated: ok {rc=0} 10:55:56.273195 --- ParallelTerminationStrategy: PID 28921 died... 10:55:56.291713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28921): Terminated: ok {rc=0} 10:55:56.378379 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:55:57.672396 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:57.679664 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:55:57.703678 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:55:57.741363 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:55:57.826920 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:55:57.850020 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:55:57.887434 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:55:58.482766 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:55:58.531341 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:58.542240 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:55:58.601841 tst cs_paging_gprs_active.py: using LAC 20978 10:55:58.721227 tst cs_paging_gprs_active.py: using RAC 68 10:55:58.839930 tst cs_paging_gprs_active.py: using CellId 20978 10:55:58.959672 tst cs_paging_gprs_active.py: using BVCI 20979 10:55:59.070417 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.081372 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.092121 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.102835 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.113640 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.124322 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.135139 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.146180 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:59.157024 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:55:59.276157 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:55:59.395711 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:55:59.615080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:59.941521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28927): Launched 10:56:00.224881 run iperf3-srv_10.42.42.10(pid=28928): Launched 10:56:00.347122 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:56:00.564724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:00.912101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28929): Launched 10:56:01.261446 run iperf3-srv_10.42.42.10(pid=28930): Launched 10:56:01.394745 tst cs_paging_gprs_active.py:38: start network... 10:56:01.603148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:02.086601 run create_hlr_db(pid=28931): Launched 10:56:02.248067 bus /gobi_6: Setting Powered False 10:56:03.313144 run create_hlr_db(pid=28931): Terminated: ok {rc=0} 10:56:03.746780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28933): Launched 10:56:04.051325 run osmo-hlr_10.42.42.2(pid=28934): Launched 10:56:04.165905 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:04.700999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28936): Launched 10:56:05.002478 run osmo-stp_10.42.42.5(pid=28937): Launched 10:56:05.116349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:05.634532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28939): Launched 10:56:05.749831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:06.005054 run patchelf(pid=28940): Launched 10:56:06.173345 run osmo-stp_10.42.42.5(pid=28937): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28937)] 10:56:06.301232 run osmo-stp_10.42.42.5(pid=28937): stdout: | (launched: 2022-12-09_10:56:04.946613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:06.430808 run osmo-stp_10.42.42.5(pid=28937): stderr: | 20221209105605114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105605114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105605115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105605115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105605116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105605116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105605116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:06.560355 run osmo-stp_10.42.42.5(pid=28937): stdout: | (launched: 2022-12-09_10:56:04.946613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:06.684387 run osmo-stp_10.42.42.5(pid=28937): stderr: | 20221209105605114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105605114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105605115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105605115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105605116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105605116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105605116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:06.831461 run patchelf(pid=28940): Terminating (SIGINT) 10:56:07.001231 run patchelf(pid=28940): Terminated: ok {rc=0} 10:56:07.123608 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28937): Process ended prematurely: osmo-stp_10.42.42.5(pid=28937) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28937)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:56:07.133061 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:56:07.160569 run osmo-hlr_10.42.42.2(pid=28934): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28934)] 10:56:07.208195 run osmo-hlr_10.42.42.2(pid=28934): stdout: | (launched: 2022-12-09_10:56:03.995493) 10:56:07.257585 run osmo-hlr_10.42.42.2(pid=28934): stderr: | 20221209105604168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105604168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105604168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105604168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105604168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105604169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105604181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105604190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105604190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105604191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:07.307667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28927): Terminating (SIGTERM) 10:56:07.347852 run iperf3-srv_10.42.42.10(pid=28928): Terminating (SIGTERM) 10:56:07.387731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28929): Terminating (SIGTERM) 10:56:07.427738 run iperf3-srv_10.42.42.10(pid=28930): Terminating (SIGTERM) 10:56:07.467531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28933): Terminating (SIGTERM) 10:56:07.507953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28936): Terminating (SIGTERM) 10:56:07.548039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28939): Terminating (SIGTERM) 10:56:07.588251 --- ParallelTerminationStrategy: PID 28927 died... 10:56:07.607559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28927): Terminated: ok {rc=0} 10:56:07.652128 --- ParallelTerminationStrategy: PID 28928 died... 10:56:07.670905 run iperf3-srv_10.42.42.10(pid=28928): Terminated {rc=256} 10:56:07.714676 --- ParallelTerminationStrategy: PID 28929 died... 10:56:07.733332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28929): Terminated: ok {rc=0} 10:56:07.777695 --- ParallelTerminationStrategy: PID 28930 died... 10:56:07.796378 run iperf3-srv_10.42.42.10(pid=28930): Terminated {rc=256} 10:56:07.840276 --- ParallelTerminationStrategy: PID 28933 died... 10:56:07.858989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28933): Terminated: ok {rc=0} 10:56:07.902781 --- ParallelTerminationStrategy: PID 28936 died... 10:56:07.921566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28936): Terminated: ok {rc=0} 10:56:07.965495 --- ParallelTerminationStrategy: PID 28939 died... 10:56:07.984154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28939): Terminated: ok {rc=0} 10:56:08.068404 bus /gobi_0: Setting Powered False 10:56:09.167044 bus /gobi_0: Setting Powered False 10:56:10.283066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:56:11.431875 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:11.443984 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:11.509426 tst iperf3.py: using LAC 20979 10:56:11.636092 tst iperf3.py: using RAC 69 10:56:11.764471 tst iperf3.py: using CellId 20979 10:56:11.893514 tst iperf3.py: using BVCI 20980 10:56:12.013163 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.024553 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.035770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.047350 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.058599 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.071090 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.082925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.094599 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:12.106582 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:12.223917 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:56:12.442351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:12.767303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28941): Launched 10:56:13.048541 run iperf3-srv_10.42.42.10(pid=28942): Launched 10:56:13.170491 tst iperf3.py:8: start network... 10:56:13.388108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:13.890163 run create_hlr_db(pid=28943): Launched 10:56:14.014469 bus /gobi_6: Setting Powered False 10:56:15.078246 run create_hlr_db(pid=28943): Terminated: ok {rc=0} 10:56:15.509106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28945): Launched 10:56:15.810444 run osmo-hlr_10.42.42.2(pid=28946): Launched 10:56:15.928900 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:16.616868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28948): Launched 10:56:16.953619 run osmo-stp_10.42.42.5(pid=28949): Launched 10:56:17.072090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:17.670228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28951): Launched 10:56:17.787462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:18.041926 run patchelf(pid=28952): Launched 10:56:18.209667 run osmo-stp_10.42.42.5(pid=28949): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28949)] 10:56:18.336596 run osmo-stp_10.42.42.5(pid=28949): stdout: | (launched: 2022-12-09_10:56:16.893446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:18.464866 run osmo-stp_10.42.42.5(pid=28949): stderr: | 20221209105617256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105617256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105617256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105617265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105617265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105617266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105617266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:18.593158 run osmo-stp_10.42.42.5(pid=28949): stdout: | (launched: 2022-12-09_10:56:16.893446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:18.716079 run osmo-stp_10.42.42.5(pid=28949): stderr: | 20221209105617256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105617256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105617256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105617265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105617265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105617266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105617266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:18.862416 run patchelf(pid=28952): Terminating (SIGINT) 10:56:19.031858 run patchelf(pid=28952): Terminated: ok {rc=0} 10:56:19.153963 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28949): Process ended prematurely: osmo-stp_10.42.42.5(pid=28949) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28949)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 10:56:19.163459 tst iperf3.py:8: Test FAILED (7.8 sec) 10:56:19.190779 run osmo-hlr_10.42.42.2(pid=28946): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28946)] 10:56:19.238422 run osmo-hlr_10.42.42.2(pid=28946): stdout: | (launched: 2022-12-09_10:56:15.755545) 10:56:19.288083 run osmo-hlr_10.42.42.2(pid=28946): stderr: | 20221209105616076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105616076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105616077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105616077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105616077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105616077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105616098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105616114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105616114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105616114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:19.337823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28941): Terminating (SIGTERM) 10:56:19.378159 run iperf3-srv_10.42.42.10(pid=28942): Terminating (SIGTERM) 10:56:19.418232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28945): Terminating (SIGTERM) 10:56:19.457914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28948): Terminating (SIGTERM) 10:56:19.497614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28951): Terminating (SIGTERM) 10:56:19.537679 --- ParallelTerminationStrategy: PID 28941 died... 10:56:19.556730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28941): Terminated: ok {rc=0} 10:56:19.601217 --- ParallelTerminationStrategy: PID 28942 died... 10:56:19.619928 run iperf3-srv_10.42.42.10(pid=28942): Terminated {rc=256} 10:56:19.663830 --- ParallelTerminationStrategy: PID 28945 died... 10:56:19.682512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28945): Terminated: ok {rc=0} 10:56:19.726355 --- ParallelTerminationStrategy: PID 28948 died... 10:56:19.744994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28948): Terminated: ok {rc=0} 10:56:19.789265 --- ParallelTerminationStrategy: PID 28951 died... 10:56:19.807682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28951): Terminated: ok {rc=0} 10:56:19.891574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:56:21.041427 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.053599 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:21.116272 tst iperf3m4.py: using LAC 20980 10:56:21.242559 tst iperf3m4.py: using RAC 70 10:56:21.370990 tst iperf3m4.py: using CellId 20980 10:56:21.500152 tst iperf3m4.py: using BVCI 20981 10:56:21.611099 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.622258 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.633423 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.644182 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.654993 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.665900 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.676729 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.687288 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:21.698051 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:21.816246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:21.935005 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:22.052937 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:22.170871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:56:22.371639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:22.674571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28953): Launched 10:56:22.939603 run iperf3-srv_10.42.42.10(pid=28954): Launched 10:56:23.052593 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:56:23.253162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:23.554467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28955): Launched 10:56:23.818994 run iperf3-srv_10.42.42.10(pid=28956): Launched 10:56:23.932575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:56:24.134335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:24.436531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28957): Launched 10:56:24.699400 run iperf3-srv_10.42.42.10(pid=28958): Launched 10:56:24.813125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:56:25.013524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:25.316010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28959): Launched 10:56:25.578605 run iperf3-srv_10.42.42.10(pid=28960): Launched 10:56:25.694387 tst iperf3m4.py:8: start network... 10:56:25.894777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:26.360351 run create_hlr_db(pid=28961): Launched 10:56:26.483759 bus /gobi_6: Setting Powered False 10:56:27.548162 run create_hlr_db(pid=28961): Terminated: ok {rc=0} 10:56:27.999841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28963): Launched 10:56:28.323671 run osmo-hlr_10.42.42.2(pid=28964): Launched 10:56:28.449555 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:29.009936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28966): Launched 10:56:29.334302 run osmo-stp_10.42.42.5(pid=28967): Launched 10:56:29.458899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:30.015637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28969): Launched 10:56:30.141406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:30.415165 run patchelf(pid=28970): Launched 10:56:30.595208 run osmo-stp_10.42.42.5(pid=28967): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28967)] 10:56:30.731851 run osmo-stp_10.42.42.5(pid=28967): stdout: | (launched: 2022-12-09_10:56:29.275267) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:30.897821 run osmo-stp_10.42.42.5(pid=28967): stderr: | 20221209105629461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105629461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105629461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105629462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105629462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105629462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105629462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:31.032237 run osmo-stp_10.42.42.5(pid=28967): stdout: | (launched: 2022-12-09_10:56:29.275267) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:31.160783 run osmo-stp_10.42.42.5(pid=28967): stderr: | 20221209105629461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105629461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105629461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105629462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105629462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105629462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105629462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:31.311237 run patchelf(pid=28970): Terminating (SIGINT) 10:56:31.486297 run patchelf(pid=28970): Terminated: ok {rc=0} 10:56:31.613252 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28967): Process ended prematurely: osmo-stp_10.42.42.5(pid=28967) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28967)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:56:31.623917 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:56:31.653309 run osmo-hlr_10.42.42.2(pid=28964): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28964)] 10:56:31.703880 run osmo-hlr_10.42.42.2(pid=28964): stdout: | (launched: 2022-12-09_10:56:28.264527) 10:56:31.756446 run osmo-hlr_10.42.42.2(pid=28964): stderr: | 20221209105628457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105628457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105628457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105628457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105628457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105628457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105628469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105628478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105628479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105628479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:31.807961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28953): Terminating (SIGTERM) 10:56:31.849623 run iperf3-srv_10.42.42.10(pid=28954): Terminating (SIGTERM) 10:56:31.895087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28955): Terminating (SIGTERM) 10:56:31.937774 run iperf3-srv_10.42.42.10(pid=28956): Terminating (SIGTERM) 10:56:31.978715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28957): Terminating (SIGTERM) 10:56:32.019666 run iperf3-srv_10.42.42.10(pid=28958): Terminating (SIGTERM) 10:56:32.060505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28959): Terminating (SIGTERM) 10:56:32.101392 run iperf3-srv_10.42.42.10(pid=28960): Terminating (SIGTERM) 10:56:32.143374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28963): Terminating (SIGTERM) 10:56:32.184775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28966): Terminating (SIGTERM) 10:56:32.225434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28969): Terminating (SIGTERM) 10:56:32.266050 --- ParallelTerminationStrategy: PID 28953 died... 10:56:32.284825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28953): Terminated: ok {rc=0} 10:56:32.329570 --- ParallelTerminationStrategy: PID 28954 died... 10:56:32.348130 run iperf3-srv_10.42.42.10(pid=28954): Terminated {rc=256} 10:56:32.392434 --- ParallelTerminationStrategy: PID 28955 died... 10:56:32.411361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28955): Terminated: ok {rc=0} 10:56:32.456046 --- ParallelTerminationStrategy: PID 28956 died... 10:56:32.475073 run iperf3-srv_10.42.42.10(pid=28956): Terminated {rc=256} 10:56:32.518916 --- ParallelTerminationStrategy: PID 28957 died... 10:56:32.537833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28957): Terminated: ok {rc=0} 10:56:32.582469 --- ParallelTerminationStrategy: PID 28958 died... 10:56:32.601325 run iperf3-srv_10.42.42.10(pid=28958): Terminated {rc=256} 10:56:32.645488 --- ParallelTerminationStrategy: PID 28959 died... 10:56:32.664379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28959): Terminated: ok {rc=0} 10:56:32.708937 --- ParallelTerminationStrategy: PID 28960 died... 10:56:32.727860 run iperf3-srv_10.42.42.10(pid=28960): Terminated {rc=256} 10:56:32.771848 --- ParallelTerminationStrategy: PID 28963 died... 10:56:32.790633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28963): Terminated: ok {rc=0} 10:56:32.834919 --- ParallelTerminationStrategy: PID 28966 died... 10:56:32.853872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28966): Terminated: ok {rc=0} 10:56:32.897950 --- ParallelTerminationStrategy: PID 28969 died... 10:56:32.916936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28969): Terminated: ok {rc=0} 10:56:33.003396 bus /gobi_4: Setting Powered False 10:56:34.104653 bus /gobi_4: Setting Powered False 10:56:35.219979 bus /gobi_1: Setting Powered False 10:56:36.320316 bus /gobi_1: Setting Powered False 10:56:37.435391 bus /gobi_0: Setting Powered False 10:56:38.533708 bus /gobi_0: Setting Powered False 10:56:39.648428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:56:40.750913 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:40.762646 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:40.823538 tst ping.py: using LAC 20981 10:56:40.940168 tst ping.py: using RAC 71 10:56:41.058473 tst ping.py: using CellId 20981 10:56:41.178788 tst ping.py: using BVCI 20982 10:56:41.287486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.298585 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.309379 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.320075 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.330814 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.341634 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.352486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:41.363279 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:41.477702 tst ping.py:19: start network... 10:56:41.674947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:42.135992 run create_hlr_db(pid=28971): Launched 10:56:42.257382 bus /gobi_6: Setting Powered False 10:56:43.317565 run create_hlr_db(pid=28971): Terminated: ok {rc=0} 10:56:43.754192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28973): Launched 10:56:44.075988 run osmo-hlr_10.42.42.2(pid=28974): Launched 10:56:44.197934 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:44.757557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28976): Launched 10:56:45.079396 run osmo-stp_10.42.42.5(pid=28977): Launched 10:56:45.202709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:45.753339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28979): Launched 10:56:45.890866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:46.161885 run patchelf(pid=28980): Launched 10:56:46.354590 run osmo-stp_10.42.42.5(pid=28977): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28977)] 10:56:46.494145 run osmo-stp_10.42.42.5(pid=28977): stdout: | (launched: 2022-12-09_10:56:45.020254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:46.634592 run osmo-stp_10.42.42.5(pid=28977): stderr: | 20221209105645207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105645207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105645208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105645208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105645209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105645209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105645209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:46.775640 run osmo-stp_10.42.42.5(pid=28977): stdout: | (launched: 2022-12-09_10:56:45.020254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:46.910837 run osmo-stp_10.42.42.5(pid=28977): stderr: | 20221209105645207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105645207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105645208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105645208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105645209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105645209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105645209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:47.070539 run patchelf(pid=28980): Terminating (SIGINT) 10:56:47.251991 run patchelf(pid=28980): Terminated: ok {rc=0} 10:56:47.381501 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28977): Process ended prematurely: osmo-stp_10.42.42.5(pid=28977) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28977)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 10:56:47.391360 tst ping.py:22: Test FAILED (6.6 sec) 10:56:47.420814 run osmo-hlr_10.42.42.2(pid=28974): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28974)] 10:56:47.471443 run osmo-hlr_10.42.42.2(pid=28974): stdout: | (launched: 2022-12-09_10:56:44.017257) 10:56:47.524033 run osmo-hlr_10.42.42.2(pid=28974): stderr: | 20221209105644211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105644211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105644211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105644211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105644211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105644211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105644224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105644232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105644233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105644233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:47.576878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28973): Terminating (SIGTERM) 10:56:47.619384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28976): Terminating (SIGTERM) 10:56:47.661753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28979): Terminating (SIGTERM) 10:56:47.704702 --- ParallelTerminationStrategy: PID 28973 died... 10:56:47.724653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28973): Terminated: ok {rc=0} 10:56:47.772383 --- ParallelTerminationStrategy: PID 28976 died... 10:56:47.791940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28976): Terminated: ok {rc=0} 10:56:47.839576 --- ParallelTerminationStrategy: PID 28979 died... 10:56:47.859194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28979): Terminated: ok {rc=0} 10:56:47.948588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:56:49.038197 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.050974 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:49.115007 tst ping_idle_ping.py: using LAC 20982 10:56:49.242332 tst ping_idle_ping.py: using RAC 72 10:56:49.369637 tst ping_idle_ping.py: using CellId 20982 10:56:49.494924 tst ping_idle_ping.py: using BVCI 20983 10:56:49.613317 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.624690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.636006 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.647770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.659274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.670869 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.682751 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:49.694829 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:49.810590 tst ping_idle_ping.py:24: start network... 10:56:50.009868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:50.472853 run create_hlr_db(pid=28981): Launched 10:56:50.597065 bus /gobi_6: Setting Powered False 10:56:51.660576 run create_hlr_db(pid=28981): Terminated: ok {rc=0} 10:56:52.105615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28983): Launched 10:56:52.427382 run osmo-hlr_10.42.42.2(pid=28984): Launched 10:56:52.550828 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:53.102483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28986): Launched 10:56:53.422087 run osmo-stp_10.42.42.5(pid=28987): Launched 10:56:53.544242 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:54.094462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28989): Launched 10:56:54.217370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:54.485329 run patchelf(pid=28990): Launched 10:56:54.664198 run osmo-stp_10.42.42.5(pid=28987): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28987)] 10:56:54.799702 run osmo-stp_10.42.42.5(pid=28987): stdout: | (launched: 2022-12-09_10:56:53.363518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:54.936227 run osmo-stp_10.42.42.5(pid=28987): stderr: | 20221209105653550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105653550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105653550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105653551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105653551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105653551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105653551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:55.072425 run osmo-stp_10.42.42.5(pid=28987): stdout: | (launched: 2022-12-09_10:56:53.363518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:55.203182 run osmo-stp_10.42.42.5(pid=28987): stderr: | 20221209105653550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105653550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105653550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105653551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105653551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105653551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105653551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:55.357865 run patchelf(pid=28990): Terminating (SIGINT) 10:56:55.536159 run patchelf(pid=28990): Terminated: ok {rc=0} 10:56:55.664925 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28987): Process ended prematurely: osmo-stp_10.42.42.5(pid=28987) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28987)] [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:56:55.674667 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:56:55.703516 run osmo-hlr_10.42.42.2(pid=28984): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28984)] 10:56:55.754169 run osmo-hlr_10.42.42.2(pid=28984): stdout: | (launched: 2022-12-09_10:56:52.368620) 10:56:55.806757 run osmo-hlr_10.42.42.2(pid=28984): stderr: | 20221209105652563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105652563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105652563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105652564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105652564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105652564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105652576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105652585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105652585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105652585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:55.859603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28983): Terminating (SIGTERM) 10:56:55.901993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28986): Terminating (SIGTERM) 10:56:55.944494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28989): Terminating (SIGTERM) 10:56:55.987073 --- ParallelTerminationStrategy: PID 28983 died... 10:56:56.007238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28983): Terminated: ok {rc=0} 10:56:56.054080 --- ParallelTerminationStrategy: PID 28986 died... 10:56:56.073789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28986): Terminated: ok {rc=0} 10:56:56.120407 --- ParallelTerminationStrategy: PID 28989 died... 10:56:56.140056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28989): Terminated: ok {rc=0} 10:56:56.229214 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 10:56:57.528291 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:56:57.537598 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:56:57.561563 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:56:57.595776 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:56:57.650536 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:56:57.675854 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:56:57.711208 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:56:58.269913 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:56:58.275212 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.286896 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:56:58.345712 tst switch_tch_pdch.py: using LAC 20983 10:56:58.461399 tst switch_tch_pdch.py: using RAC 73 10:56:58.576634 tst switch_tch_pdch.py: using CellId 20983 10:56:58.696615 tst switch_tch_pdch.py: using BVCI 20984 10:56:58.806390 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.817917 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.829368 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.840803 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.852247 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.863598 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.875224 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:56:58.886738 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:56:59.005549 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:56:59.122166 tst switch_tch_pdch.py:51: start network... 10:56:59.319018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:59.780154 run create_hlr_db(pid=28994): Launched 10:56:59.902219 bus /gobi_6: Setting Powered False 10:57:00.973647 run create_hlr_db(pid=28994): Terminated: ok {rc=0} 10:57:01.466713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28996): Launched 10:57:01.811011 run osmo-hlr_10.42.42.2(pid=28997): Launched 10:57:01.963917 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:02.657273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28999): Launched 10:57:02.976876 run osmo-stp_10.42.42.5(pid=29000): Launched 10:57:03.098426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:03.646842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29002): Launched 10:57:03.768646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:04.039116 run patchelf(pid=29003): Launched 10:57:04.217404 run osmo-stp_10.42.42.5(pid=29000): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29000)] 10:57:04.353161 run osmo-stp_10.42.42.5(pid=29000): stdout: | (launched: 2022-12-09_10:57:02.918494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:04.489802 run osmo-stp_10.42.42.5(pid=29000): stderr: | 20221209105703104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105703105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105703105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105703105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105703106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105703106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105703106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:04.626785 run osmo-stp_10.42.42.5(pid=29000): stdout: | (launched: 2022-12-09_10:57:02.918494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:04.757202 run osmo-stp_10.42.42.5(pid=29000): stderr: | 20221209105703104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105703105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105703105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105703105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105703106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105703106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105703106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:04.913042 run patchelf(pid=29003): Terminating (SIGINT) 10:57:05.091415 run patchelf(pid=29003): Terminated: ok {rc=0} 10:57:05.220168 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29000): Process ended prematurely: osmo-stp_10.42.42.5(pid=29000) [trial-2358↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29000)] [trial-2358↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:57:05.229956 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:57:05.258657 run osmo-hlr_10.42.42.2(pid=28997): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28997)] 10:57:05.309890 run osmo-hlr_10.42.42.2(pid=28997): stdout: | (launched: 2022-12-09_10:57:01.752331) 10:57:05.362579 run osmo-hlr_10.42.42.2(pid=28997): stderr: | 20221209105702154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105702154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105702154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105702154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105702155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105702155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105702171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105702180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105702180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105702180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:05.415786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28996): Terminating (SIGTERM) 10:57:05.458083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28999): Terminating (SIGTERM) 10:57:05.500378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29002): Terminating (SIGTERM) 10:57:05.543115 --- ParallelTerminationStrategy: PID 28996 died... 10:57:05.563124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28996): Terminated: ok {rc=0} 10:57:05.610585 --- ParallelTerminationStrategy: PID 28999 died... 10:57:05.630489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28999): Terminated: ok {rc=0} 10:57:05.677812 --- ParallelTerminationStrategy: PID 29002 died... 10:57:05.697647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29002): Terminated: ok {rc=0} 10:57:05.786803 bus /gobi_0: Setting Powered False 10:57:06.884834 bus /gobi_0: Setting Powered False 10:57:07.999864 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 sms:nanobts+band-900 --------------------------------------------------------------------- 10:57:09.248205 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:09.253233 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:57:09.284682 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:57:09.310869 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 10:57:09.363492 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:57:09.395193 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:57:09.421131 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 10:57:09.966682 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 10:57:09.971597 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:09.982221 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:10.028592 tst mo_mt_sms.py: using LAC 20984 10:57:10.145119 tst mo_mt_sms.py: using RAC 74 10:57:10.260626 tst mo_mt_sms.py: using CellId 20984 10:57:10.377331 tst mo_mt_sms.py: using BVCI 20985 10:57:10.484091 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:10.494692 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:10.505207 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:10.515621 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:10.526358 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:10.536671 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 10:57:10.653464 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 10:57:10.767682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:11.229282 run create_hlr_db(pid=29009): Launched 10:57:11.351213 bus /gobi_6: Setting Powered False 10:57:12.410744 run create_hlr_db(pid=29009): Terminated: ok {rc=0} 10:57:12.846160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Launched 10:57:13.163039 run osmo-hlr_10.42.42.2(pid=29012): Launched 10:57:13.285881 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:13.836032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Launched 10:57:14.154384 run osmo-stp_10.42.42.5(pid=29015): Launched 10:57:14.274834 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:14.850332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29017): Launched 10:57:15.169082 run osmo-msc_10.42.42.6(pid=29018): Launched 10:57:15.344061 run osmo-stp_10.42.42.5(pid=29015): ERR: Terminated: ERROR {rc=1} [trial-2358↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] 10:57:15.470521 run osmo-stp_10.42.42.5(pid=29015): stdout: | (launched: 2022-12-09_10:57:14.095390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:15.597813 run osmo-stp_10.42.42.5(pid=29015): stderr: | 20221209105714282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105714282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105714283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105714283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105714283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105714283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105714284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:15.721876 run osmo-stp_10.42.42.5(pid=29015): stdout: | (launched: 2022-12-09_10:57:14.095390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:15.850389 run osmo-stp_10.42.42.5(pid=29015): stderr: | 20221209105714282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105714282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105714283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105714283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105714283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105714283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105714284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:16.023817 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29015): Process ended prematurely: osmo-stp_10.42.42.5(pid=29015) [trial-2358↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] [trial-2358↪sms:nanobts+band-900↪mo_mt_sms.py:16] 10:57:16.034392 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 10:57:16.066182 run osmo-hlr_10.42.42.2(pid=29012): ERR: Terminated: ERROR {rc=237} [trial-2358↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29012)] 10:57:16.121198 run osmo-hlr_10.42.42.2(pid=29012): stdout: | (launched: 2022-12-09_10:57:13.104714) 10:57:16.177217 run osmo-hlr_10.42.42.2(pid=29012): stderr: | 20221209105713297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105713297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105713297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105713297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105713297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105713297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105713308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105713320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105713320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105713320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:16.254362 run osmo-msc_10.42.42.6(pid=29018): ERR: Terminated: ERROR {rc=2} [trial-2358↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29018)] 10:57:16.307689 run osmo-msc_10.42.42.6(pid=29018): stdout: | (launched: 2022-12-09_10:57:15.109967) 10:57:16.364327 run osmo-msc_10.42.42.6(pid=29018): stderr: | 20221209105715407 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105715408 DLGLOBAL DEBUG validating counter group 0x7ff64c19fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105715408 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105715408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105715408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105715408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105715410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105715410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105715411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105715411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:16.419783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Terminating (SIGTERM) 10:57:16.464733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Terminating (SIGTERM) 10:57:16.509215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29017): Terminating (SIGTERM) 10:57:16.554957 --- ParallelTerminationStrategy: PID 29011 died... 10:57:16.575904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Terminated: ok {rc=0} 10:57:16.626140 --- ParallelTerminationStrategy: PID 29014 died... 10:57:16.646861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Terminated: ok {rc=0} 10:57:16.697251 --- ParallelTerminationStrategy: PID 29017 died... 10:57:16.719019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29017): Terminated: ok {rc=0} 10:57:16.811742 bus /sierra_3: Setting Powered False 10:57:17.911190 bus /sierra_3: Setting Powered False 10:57:19.026292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 10:57:20.266731 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:20.271934 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:57:20.305958 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 10:57:20.313169 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 10:57:20.347572 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:57:20.380701 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 10:57:20.387806 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 10:57:20.909333 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 10:57:20.914741 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 10:57:20.926299 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:20.974710 tst assert_extension.py: using LAC 20985 10:57:21.092830 tst assert_extension.py: using RAC 75 10:57:21.208659 tst assert_extension.py: using CellId 20985 10:57:21.323839 tst assert_extension.py: using BVCI 20986 10:57:21.431395 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 10:57:21.548235 tst assert_extension.py:10: start nitb and bts... 10:57:21.761973 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:57:22.412433 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29023): Launched 10:57:22.733082 run osmo-nitb_10.42.42.2(pid=29024): Launched 10:57:22.912141 run osmo-nitb_10.42.42.2(pid=29024): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29024)] 10:57:23.055141 run osmo-nitb_10.42.42.2(pid=29024): stdout: | (launched: 2022-12-09_10:57:22.674303) 10:57:23.199938 run osmo-nitb_10.42.42.2(pid=29024): stderr: | (launched: 2022-12-09_10:57:22.721808) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:57:23.344443 run osmo-nitb_10.42.42.2(pid=29024): stdout: | (launched: 2022-12-09_10:57:22.674303) 10:57:23.483788 run osmo-nitb_10.42.42.2(pid=29024): stderr: | (launched: 2022-12-09_10:57:22.721808) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29024): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29024) [trial-2358↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29024)] 10:57:23.856049 tst osmo-nitb_10.42.42.2(pid=29024): stdout: | (launched: 2022-12-09_10:57:22.674303) 10:57:23.985408 tst osmo-nitb_10.42.42.2(pid=29024): stderr: | (launched: 2022-12-09_10:57:22.721808) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:57:24.137081 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29024): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29024) [trial-2358↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29024)] [trial-2358↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 10:57:24.146383 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:57:24.153615 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29023): Terminating (SIGTERM) 10:57:24.365276 --- ParallelTerminationStrategy: PID 29023 died... 10:57:24.386568 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29023): Terminated: ok {rc=0} 10:57:24.475105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 ussd:nanobts+band-900 --------------------------------------------------------------------- 10:57:25.647317 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:25.652105 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:57:25.684342 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:57:25.710706 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 10:57:25.745993 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:57:25.777921 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:57:25.804274 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 10:57:26.332876 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 10:57:26.338008 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:26.348720 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:26.396040 tst assert_extension.py: using LAC 20986 10:57:26.514225 tst assert_extension.py: using RAC 76 10:57:26.634074 tst assert_extension.py: using CellId 20986 10:57:26.750530 tst assert_extension.py: using BVCI 20987 10:57:26.859555 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:26.870200 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:26.880640 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:26.891643 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:26.902685 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:26.913746 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 10:57:27.030793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:27.525385 run create_hlr_db(pid=29028): Launched 10:57:27.649562 bus /sierra_2: Setting Powered False 10:57:28.712597 run create_hlr_db(pid=29028): Terminated: ok {rc=0} 10:57:29.157092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29030): Launched 10:57:29.477244 run osmo-hlr_10.42.42.2(pid=29031): Launched 10:57:29.600692 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:30.158013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29033): Launched 10:57:30.476089 run osmo-stp_10.42.42.5(pid=29034): Launched 10:57:30.598673 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:31.185227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29036): Launched 10:57:31.509800 run osmo-msc_10.42.42.6(pid=29037): Launched 10:57:31.815631 run osmo-stp_10.42.42.5(pid=29034): ERR: Terminated: ERROR {rc=1} [trial-2358↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29034)] 10:57:32.099929 run osmo-stp_10.42.42.5(pid=29034): stdout: | (launched: 2022-12-09_10:57:30.417454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:32.309676 run osmo-stp_10.42.42.5(pid=29034): stderr: | 20221209105730604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105730604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105730604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105730605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105730605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105730605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105730605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:32.446229 run osmo-stp_10.42.42.5(pid=29034): stdout: | (launched: 2022-12-09_10:57:30.417454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:32.572746 run osmo-stp_10.42.42.5(pid=29034): stderr: | 20221209105730604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105730604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105730604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105730605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105730605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105730605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105730605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:32.724588 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29034): Process ended prematurely: osmo-stp_10.42.42.5(pid=29034) [trial-2358↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29034)] [trial-2358↪ussd:nanobts+band-900↪assert_extension.py:17] 10:57:32.734033 tst assert_extension.py:17: Test FAILED (6.4 sec) 10:57:32.762572 run osmo-hlr_10.42.42.2(pid=29031): ERR: Terminated: ERROR {rc=237} [trial-2358↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29031)] 10:57:32.813871 run osmo-hlr_10.42.42.2(pid=29031): stdout: | (launched: 2022-12-09_10:57:29.418615) 10:57:32.866831 run osmo-hlr_10.42.42.2(pid=29031): stderr: | 20221209105729613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105729613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105729613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105729613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105729613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105729613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105729625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105729633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105729634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105729634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:32.939800 run osmo-msc_10.42.42.6(pid=29037): ERR: Terminated: ERROR {rc=2} [trial-2358↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29037)] 10:57:32.990315 run osmo-msc_10.42.42.6(pid=29037): stdout: | (launched: 2022-12-09_10:57:31.447780) 10:57:33.042654 run osmo-msc_10.42.42.6(pid=29037): stderr: | 20221209105732068 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105732068 DLGLOBAL DEBUG validating counter group 0x7fb941cadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105732068 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105732068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105732070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105732070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105732072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105732072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105732072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105732072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:33.095455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29030): Terminating (SIGTERM) 10:57:33.137747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29033): Terminating (SIGTERM) 10:57:33.180173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29036): Terminating (SIGTERM) 10:57:33.222939 --- ParallelTerminationStrategy: PID 29030 died... 10:57:33.243142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29030): Terminated: ok {rc=0} 10:57:33.290395 --- ParallelTerminationStrategy: PID 29033 died... 10:57:33.310206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29033): Terminated: ok {rc=0} 10:57:33.356916 --- ParallelTerminationStrategy: PID 29036 died... 10:57:33.376809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29036): Terminated: ok {rc=0} 10:57:33.465765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:57:34.679002 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:34.687290 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:57:34.721480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:57:34.748842 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:57:34.802454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:57:34.836669 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:57:34.864395 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:57:35.414644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:57:35.467784 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:35.479375 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:57:35.553050 tst mo_mt_call.py: using LAC 20987 10:57:35.682173 tst mo_mt_call.py: using RAC 77 10:57:35.814155 tst mo_mt_call.py: using CellId 20987 10:57:35.939489 tst mo_mt_call.py: using BVCI 20988 10:57:36.050389 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:36.061543 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:36.072416 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:36.083924 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:36.095458 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:36.106972 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:57:36.226611 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:57:36.346248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:36.849282 run create_hlr_db(pid=29044): Launched 10:57:36.973630 bus /sierra_2: Setting Powered False 10:57:38.038002 run create_hlr_db(pid=29044): Terminated: ok {rc=0} 10:57:38.470665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Launched 10:57:38.771450 run osmo-hlr_10.42.42.2(pid=29047): Launched 10:57:38.886496 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:39.404682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Launched 10:57:39.705657 run osmo-stp_10.42.42.5(pid=29050): Launched 10:57:39.821942 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:40.371126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29052): Launched 10:57:40.672549 run osmo-msc_10.42.42.6(pid=29053): Launched 10:57:40.842008 run osmo-stp_10.42.42.5(pid=29050): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] 10:57:40.969746 run osmo-stp_10.42.42.5(pid=29050): stdout: | (launched: 2022-12-09_10:57:39.650157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:41.096742 run osmo-stp_10.42.42.5(pid=29050): stderr: | 20221209105739816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105739817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105739817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105739817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105739818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105739818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105739818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:41.221936 run osmo-stp_10.42.42.5(pid=29050): stdout: | (launched: 2022-12-09_10:57:39.650157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:41.341757 run osmo-stp_10.42.42.5(pid=29050): stderr: | 20221209105739816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105739817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105739817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105739817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105739818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105739818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105739818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:41.485293 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29050): Process ended prematurely: osmo-stp_10.42.42.5(pid=29050) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:57:41.494233 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:57:41.520709 run osmo-hlr_10.42.42.2(pid=29047): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29047)] 10:57:41.568461 run osmo-hlr_10.42.42.2(pid=29047): stdout: | (launched: 2022-12-09_10:57:38.715975) 10:57:41.617567 run osmo-hlr_10.42.42.2(pid=29047): stderr: | 20221209105738887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105738887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105738887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105738887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105738887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105738887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105738899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105738910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105738910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105738910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:41.686451 run osmo-msc_10.42.42.6(pid=29053): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29053)] 10:57:41.733794 run osmo-msc_10.42.42.6(pid=29053): stdout: | (launched: 2022-12-09_10:57:40.616911) 10:57:41.782877 run osmo-msc_10.42.42.6(pid=29053): stderr: | 20221209105740882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105740883 DLGLOBAL DEBUG validating counter group 0x7f97a3399c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105740883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105740883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105740883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105740883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105740885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105740885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105740885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105740885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:41.832632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Terminating (SIGTERM) 10:57:41.871949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Terminating (SIGTERM) 10:57:41.911507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29052): Terminating (SIGTERM) 10:57:41.951486 --- ParallelTerminationStrategy: PID 29046 died... 10:57:41.970575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Terminated: ok {rc=0} 10:57:42.014270 --- ParallelTerminationStrategy: PID 29049 died... 10:57:42.032607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Terminated: ok {rc=0} 10:57:42.076178 --- ParallelTerminationStrategy: PID 29052 died... 10:57:42.094750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29052): Terminated: ok {rc=0} 10:57:42.177644 bus /sierra_3: Setting Powered False 10:57:43.276068 bus /sierra_3: Setting Powered False 10:57:44.392996 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:57:45.541504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:45.553802 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:57:45.622822 tst mo_mt_call_osmux.py: using LAC 20988 10:57:45.751157 tst mo_mt_call_osmux.py: using RAC 78 10:57:45.880835 tst mo_mt_call_osmux.py: using CellId 20988 10:57:46.018583 tst mo_mt_call_osmux.py: using BVCI 20989 10:57:46.148730 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:46.161570 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:46.174782 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:46.188152 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:46.200843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:57:46.214103 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:57:46.334199 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:57:46.478543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:47.031396 run create_hlr_db(pid=29055): Launched 10:57:47.225454 bus /sierra_2: Setting Powered False 10:57:48.290316 run create_hlr_db(pid=29055): Terminated: ok {rc=0} 10:57:48.722401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29057): Launched 10:57:49.025213 run osmo-hlr_10.42.42.2(pid=29058): Launched 10:57:49.139244 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:49.677113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29060): Launched 10:57:49.980094 run osmo-stp_10.42.42.5(pid=29061): Launched 10:57:50.095496 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:50.646349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29063): Launched 10:57:50.948545 run osmo-msc_10.42.42.6(pid=29064): Launched 10:57:51.118266 run osmo-stp_10.42.42.5(pid=29061): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29061)] 10:57:51.247424 run osmo-stp_10.42.42.5(pid=29061): stdout: | (launched: 2022-12-09_10:57:49.923812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:51.375289 run osmo-stp_10.42.42.5(pid=29061): stderr: | 20221209105750089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105750089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105750090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105750090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105750090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105750090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105750091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:51.500912 run osmo-stp_10.42.42.5(pid=29061): stdout: | (launched: 2022-12-09_10:57:49.923812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:51.621626 run osmo-stp_10.42.42.5(pid=29061): stderr: | 20221209105750089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105750089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105750090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105750090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105750090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105750090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105750091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:51.765904 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29061): Process ended prematurely: osmo-stp_10.42.42.5(pid=29061) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29061)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:57:51.775033 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:57:51.801621 run osmo-hlr_10.42.42.2(pid=29058): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29058)] 10:57:51.849304 run osmo-hlr_10.42.42.2(pid=29058): stdout: | (launched: 2022-12-09_10:57:48.969329) 10:57:51.919330 run osmo-hlr_10.42.42.2(pid=29058): stderr: | 20221209105749143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105749143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105749143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105749143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105749143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105749143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105749155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105749164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105749164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105749164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:51.998632 run osmo-msc_10.42.42.6(pid=29064): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29064)] 10:57:52.049223 run osmo-msc_10.42.42.6(pid=29064): stdout: | (launched: 2022-12-09_10:57:50.892604) 10:57:52.101412 run osmo-msc_10.42.42.6(pid=29064): stderr: | 20221209105751161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105751161 DLGLOBAL DEBUG validating counter group 0x7f9f3ef53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105751162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105751162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105751162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105751162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105751164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105751164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105751164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105751165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:52.154391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29057): Terminating (SIGTERM) 10:57:52.197127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29060): Terminating (SIGTERM) 10:57:52.239669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29063): Terminating (SIGTERM) 10:57:52.282533 --- ParallelTerminationStrategy: PID 29057 died... 10:57:52.302809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29057): Terminated: ok {rc=0} 10:57:52.350180 --- ParallelTerminationStrategy: PID 29060 died... 10:57:52.370096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29060): Terminated: ok {rc=0} 10:57:52.417232 --- ParallelTerminationStrategy: PID 29063 died... 10:57:52.437051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29063): Terminated: ok {rc=0} 10:57:52.526497 bus /sierra_3: Setting Powered False 10:57:53.626305 bus /sierra_3: Setting Powered False 10:57:54.743276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:57:55.994240 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:56.003472 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:57:56.037395 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:57:56.064610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:57:56.118581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:57:56.152644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:57:56.179781 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:57:56.730616 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:57:56.782507 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:57:56.794081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:57:56.862582 tst mo_mt_call.py: using LAC 20989 10:57:56.988587 tst mo_mt_call.py: using RAC 79 10:57:57.116094 tst mo_mt_call.py: using CellId 20989 10:57:57.242324 tst mo_mt_call.py: using BVCI 20990 10:57:57.359600 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:57:57.371188 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:57:57.382626 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:57:57.394726 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:57:57.406456 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:57:57.418066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:57:57.532451 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:57:57.651457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:58.154147 run create_hlr_db(pid=29069): Launched 10:57:58.277606 bus /sierra_2: Setting Powered False 10:57:59.342125 run create_hlr_db(pid=29069): Terminated: ok {rc=0} 10:57:59.774061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29071): Launched 10:58:00.077416 run osmo-hlr_10.42.42.2(pid=29072): Launched 10:58:00.193186 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:00.731877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29074): Launched 10:58:01.063503 run osmo-stp_10.42.42.5(pid=29075): Launched 10:58:01.302862 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:01.952310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29077): Launched 10:58:02.291804 run osmo-msc_10.42.42.6(pid=29078): Launched 10:58:02.486686 run osmo-stp_10.42.42.5(pid=29075): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29075)] 10:58:02.614252 run osmo-stp_10.42.42.5(pid=29075): stdout: | (launched: 2022-12-09_10:58:01.000673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:02.741379 run osmo-stp_10.42.42.5(pid=29075): stderr: | 20221209105801234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105801234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105801234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105801235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105801235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105801235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105801235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:02.867181 run osmo-stp_10.42.42.5(pid=29075): stdout: | (launched: 2022-12-09_10:58:01.000673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:02.987485 run osmo-stp_10.42.42.5(pid=29075): stderr: | 20221209105801234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105801234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105801234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105801235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105801235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105801235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105801235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:03.131800 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29075): Process ended prematurely: osmo-stp_10.42.42.5(pid=29075) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29075)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:58:03.141025 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:58:03.167888 run osmo-hlr_10.42.42.2(pid=29072): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29072)] 10:58:03.215565 run osmo-hlr_10.42.42.2(pid=29072): stdout: | (launched: 2022-12-09_10:58:00.020811) 10:58:03.265056 run osmo-hlr_10.42.42.2(pid=29072): stderr: | 20221209105800193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105800193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105800194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105800194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105800194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105800194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105800206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105800217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105800217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105800217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:03.334220 run osmo-msc_10.42.42.6(pid=29078): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29078)] 10:58:03.382363 run osmo-msc_10.42.42.6(pid=29078): stdout: | (launched: 2022-12-09_10:58:02.231138) 10:58:03.431759 run osmo-msc_10.42.42.6(pid=29078): stderr: | 20221209105802534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105802535 DLGLOBAL DEBUG validating counter group 0x7fdd8d36cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105802535 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105802535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105802535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105802535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105802538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105802538 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105802538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105802539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:03.481333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29071): Terminating (SIGTERM) 10:58:03.521075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29074): Terminating (SIGTERM) 10:58:03.561043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29077): Terminating (SIGTERM) 10:58:03.601302 --- ParallelTerminationStrategy: PID 29071 died... 10:58:03.620511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29071): Terminated: ok {rc=0} 10:58:03.664608 --- ParallelTerminationStrategy: PID 29074 died... 10:58:03.683580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29074): Terminated: ok {rc=0} 10:58:03.727965 --- ParallelTerminationStrategy: PID 29077 died... 10:58:03.746777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29077): Terminated: ok {rc=0} 10:58:03.833194 bus /sierra_3: Setting Powered False 10:58:04.933336 bus /sierra_3: Setting Powered False 10:58:06.046989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:58:07.196645 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:58:07.208891 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:58:07.278494 tst mo_mt_call_osmux.py: using LAC 20990 10:58:07.406907 tst mo_mt_call_osmux.py: using RAC 80 10:58:07.533927 tst mo_mt_call_osmux.py: using CellId 20990 10:58:07.661762 tst mo_mt_call_osmux.py: using BVCI 20991 10:58:07.771146 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:58:07.782433 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:58:07.793665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:58:07.804512 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:58:07.815730 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:58:07.826707 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:58:07.947052 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:58:08.063581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:08.534430 run create_hlr_db(pid=29080): Launched 10:58:08.660264 bus /sierra_2: Setting Powered False 10:58:09.721271 run create_hlr_db(pid=29080): Terminated: ok {rc=0} 10:58:10.164003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29082): Launched 10:58:10.487997 run osmo-hlr_10.42.42.2(pid=29083): Launched 10:58:10.613236 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:11.178589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29085): Launched 10:58:11.503147 run osmo-stp_10.42.42.5(pid=29086): Launched 10:58:11.626989 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:12.217951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29088): Launched 10:58:12.542336 run osmo-msc_10.42.42.6(pid=29089): Launched 10:58:12.723527 run osmo-stp_10.42.42.5(pid=29086): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29086)] 10:58:12.860639 run osmo-stp_10.42.42.5(pid=29086): stdout: | (launched: 2022-12-09_10:58:11.443440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:12.998204 run osmo-stp_10.42.42.5(pid=29086): stderr: | 20221209105811634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105811634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105811634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105811635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105811635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105811635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105811635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:13.133494 run osmo-stp_10.42.42.5(pid=29086): stdout: | (launched: 2022-12-09_10:58:11.443440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:13.262896 run osmo-stp_10.42.42.5(pid=29086): stderr: | 20221209105811634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105811634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105811634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105811635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105811635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105811635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105811635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:13.417765 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29086): Process ended prematurely: osmo-stp_10.42.42.5(pid=29086) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29086)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:58:13.427567 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:58:13.456250 run osmo-hlr_10.42.42.2(pid=29083): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29083)] 10:58:13.506563 run osmo-hlr_10.42.42.2(pid=29083): stdout: | (launched: 2022-12-09_10:58:10.428540) 10:58:13.558696 run osmo-hlr_10.42.42.2(pid=29083): stderr: | 20221209105810625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105810625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105810625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105810625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105810625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105810625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105810638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105810646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105810646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105810646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:13.631350 run osmo-msc_10.42.42.6(pid=29089): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29089)] 10:58:13.681508 run osmo-msc_10.42.42.6(pid=29089): stdout: | (launched: 2022-12-09_10:58:12.482284) 10:58:13.733518 run osmo-msc_10.42.42.6(pid=29089): stderr: | 20221209105812801 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105812801 DLGLOBAL DEBUG validating counter group 0x7f437d01cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105812801 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105812801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105812802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105812802 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105812803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105812804 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105812804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105812804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:13.785706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29082): Terminating (SIGTERM) 10:58:13.828121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29085): Terminating (SIGTERM) 10:58:13.870389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29088): Terminating (SIGTERM) 10:58:13.912616 --- ParallelTerminationStrategy: PID 29082 died... 10:58:13.932644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29082): Terminated: ok {rc=0} 10:58:13.979000 --- ParallelTerminationStrategy: PID 29085 died... 10:58:13.998614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29085): Terminated: ok {rc=0} 10:58:14.045213 --- ParallelTerminationStrategy: PID 29088 died... 10:58:14.064599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29088): Terminated: ok {rc=0} 10:58:14.152147 bus /sierra_3: Setting Powered False 10:58:15.250636 bus /sierra_3: Setting Powered False 10:58:16.367957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:58:17.622543 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:17.630732 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:58:17.664192 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:58:17.691574 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:58:17.744678 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:58:17.777875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:58:17.805339 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:58:18.357636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:58:18.407908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:18.419246 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:58:18.485533 tst mo_mt_call.py: using LAC 20991 10:58:18.610669 tst mo_mt_call.py: using RAC 81 10:58:18.727651 tst mo_mt_call.py: using CellId 20991 10:58:18.844117 tst mo_mt_call.py: using BVCI 20992 10:58:18.952719 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:18.963851 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:18.974957 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:18.985871 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:18.996778 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:19.007663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:58:19.126228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:58:19.242487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:19.710830 run create_hlr_db(pid=29094): Launched 10:58:19.834443 bus /sierra_2: Setting Powered False 10:58:20.894185 run create_hlr_db(pid=29094): Terminated: ok {rc=0} 10:58:21.335816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29096): Launched 10:58:21.661646 run osmo-hlr_10.42.42.2(pid=29097): Launched 10:58:21.787210 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:22.345818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29099): Launched 10:58:22.670548 run osmo-stp_10.42.42.5(pid=29100): Launched 10:58:22.794895 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:23.379237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29102): Launched 10:58:23.705356 run osmo-msc_10.42.42.6(pid=29103): Launched 10:58:23.889339 run osmo-stp_10.42.42.5(pid=29100): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29100)] 10:58:24.026426 run osmo-stp_10.42.42.5(pid=29100): stdout: | (launched: 2022-12-09_10:58:22.610786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:24.163544 run osmo-stp_10.42.42.5(pid=29100): stderr: | 20221209105822799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105822799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105822799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105822800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105822800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105822800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105822800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:24.298322 run osmo-stp_10.42.42.5(pid=29100): stdout: | (launched: 2022-12-09_10:58:22.610786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:24.427292 run osmo-stp_10.42.42.5(pid=29100): stderr: | 20221209105822799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105822799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105822799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105822800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105822800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105822800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105822800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:24.581972 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29100): Process ended prematurely: osmo-stp_10.42.42.5(pid=29100) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29100)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:58:24.591702 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:58:24.620832 run osmo-hlr_10.42.42.2(pid=29097): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29097)] 10:58:24.671243 run osmo-hlr_10.42.42.2(pid=29097): stdout: | (launched: 2022-12-09_10:58:21.602555) 10:58:24.723488 run osmo-hlr_10.42.42.2(pid=29097): stderr: | 20221209105821796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105821796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105821796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105821796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105821796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105821796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105821808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105821817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105821817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105821818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:24.796572 run osmo-msc_10.42.42.6(pid=29103): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29103)] 10:58:24.847645 run osmo-msc_10.42.42.6(pid=29103): stdout: | (launched: 2022-12-09_10:58:23.645875) 10:58:24.899919 run osmo-msc_10.42.42.6(pid=29103): stderr: | 20221209105823963 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105823963 DLGLOBAL DEBUG validating counter group 0x7efd1b557c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105823963 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105823963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105823964 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105823964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105823965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105823966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105823966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105823966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:24.952454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29096): Terminating (SIGTERM) 10:58:24.994279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29099): Terminating (SIGTERM) 10:58:25.036036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29102): Terminating (SIGTERM) 10:58:25.078218 --- ParallelTerminationStrategy: PID 29096 died... 10:58:25.098370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29096): Terminated: ok {rc=0} 10:58:25.145143 --- ParallelTerminationStrategy: PID 29099 died... 10:58:25.164802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29099): Terminated: ok {rc=0} 10:58:25.211292 --- ParallelTerminationStrategy: PID 29102 died... 10:58:25.231101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29102): Terminated: ok {rc=0} 10:58:25.319302 bus /sierra_3: Setting Powered False 10:58:26.419747 bus /sierra_3: Setting Powered False 10:58:27.535395 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:58:28.682013 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:28.694089 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:58:28.761098 tst mo_mt_call_osmux.py: using LAC 20992 10:58:28.880301 tst mo_mt_call_osmux.py: using RAC 82 10:58:28.999156 tst mo_mt_call_osmux.py: using CellId 20992 10:58:29.120007 tst mo_mt_call_osmux.py: using BVCI 20993 10:58:29.230902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:29.242138 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:29.253171 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:29.264152 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:29.275154 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:58:29.286228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:58:29.400740 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:58:29.524936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:30.030256 run create_hlr_db(pid=29105): Launched 10:58:30.156510 bus /sierra_2: Setting Powered False 10:58:31.217458 run create_hlr_db(pid=29105): Terminated: ok {rc=0} 10:58:31.674251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29107): Launched 10:58:32.019524 run osmo-hlr_10.42.42.2(pid=29108): Launched 10:58:32.211950 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:32.750404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29110): Launched 10:58:33.054670 run osmo-stp_10.42.42.5(pid=29111): Launched 10:58:33.172457 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:33.721607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29113): Launched 10:58:34.026528 run osmo-msc_10.42.42.6(pid=29114): Launched 10:58:34.198190 run osmo-stp_10.42.42.5(pid=29111): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29111)] 10:58:34.325584 run osmo-stp_10.42.42.5(pid=29111): stdout: | (launched: 2022-12-09_10:58:32.998878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:34.453159 run osmo-stp_10.42.42.5(pid=29111): stderr: | 20221209105833164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105833164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105833165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105833165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105833166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105833166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105833166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:34.578591 run osmo-stp_10.42.42.5(pid=29111): stdout: | (launched: 2022-12-09_10:58:32.998878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:34.700087 run osmo-stp_10.42.42.5(pid=29111): stderr: | 20221209105833164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105833164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105833165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105833165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105833166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105833166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105833166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:34.844362 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29111): Process ended prematurely: osmo-stp_10.42.42.5(pid=29111) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29111)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:58:34.853617 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:58:34.880130 run osmo-hlr_10.42.42.2(pid=29108): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29108)] 10:58:34.927875 run osmo-hlr_10.42.42.2(pid=29108): stdout: | (launched: 2022-12-09_10:58:31.957228) 10:58:34.977174 run osmo-hlr_10.42.42.2(pid=29108): stderr: | 20221209105832230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105832230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105832230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105832230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105832230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105832230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105832242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105832250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105832251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105832251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:35.045909 run osmo-msc_10.42.42.6(pid=29114): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29114)] 10:58:35.093428 run osmo-msc_10.42.42.6(pid=29114): stdout: | (launched: 2022-12-09_10:58:33.970113) 10:58:35.142413 run osmo-msc_10.42.42.6(pid=29114): stderr: | 20221209105834238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105834239 DLGLOBAL DEBUG validating counter group 0x7f6a1309cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105834239 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105834239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105834239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105834239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105834241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105834241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105834241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105834241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:35.191994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29107): Terminating (SIGTERM) 10:58:35.231688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29110): Terminating (SIGTERM) 10:58:35.271056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29113): Terminating (SIGTERM) 10:58:35.310914 --- ParallelTerminationStrategy: PID 29107 died... 10:58:35.330056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29107): Terminated: ok {rc=0} 10:58:35.374098 --- ParallelTerminationStrategy: PID 29110 died... 10:58:35.392747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29110): Terminated: ok {rc=0} 10:58:35.436838 --- ParallelTerminationStrategy: PID 29113 died... 10:58:35.455860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29113): Terminated: ok {rc=0} 10:58:35.539646 bus /sierra_3: Setting Powered False 10:58:36.638335 bus /sierra_3: Setting Powered False 10:58:37.756227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:58:39.006393 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:39.013659 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:58:39.045480 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:58:39.071565 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:58:39.123377 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:58:39.156566 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:58:39.183732 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:58:39.731211 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:58:39.780069 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:39.791398 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:58:39.862518 tst mo_mt_call.py: using LAC 20993 10:58:39.979984 tst mo_mt_call.py: using RAC 83 10:58:40.096709 tst mo_mt_call.py: using CellId 20993 10:58:40.213291 tst mo_mt_call.py: using BVCI 20994 10:58:40.324531 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:40.335804 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:40.346761 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:40.357815 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:40.368708 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:40.379849 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:58:40.498598 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:58:40.617043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:41.120247 run create_hlr_db(pid=29120): Launched 10:58:41.244385 bus /sierra_2: Setting Powered False 10:58:42.309166 run create_hlr_db(pid=29120): Terminated: ok {rc=0} 10:58:42.741198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29122): Launched 10:58:43.044193 run osmo-hlr_10.42.42.2(pid=29123): Launched 10:58:43.159705 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:43.681581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29125): Launched 10:58:43.985305 run osmo-stp_10.42.42.5(pid=29126): Launched 10:58:44.100237 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:44.645554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29128): Launched 10:58:44.949427 run osmo-msc_10.42.42.6(pid=29129): Launched 10:58:45.118790 run osmo-stp_10.42.42.5(pid=29126): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29126)] 10:58:45.246544 run osmo-stp_10.42.42.5(pid=29126): stdout: | (launched: 2022-12-09_10:58:43.929269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:45.374141 run osmo-stp_10.42.42.5(pid=29126): stderr: | 20221209105844097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105844097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105844097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105844097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105844098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105844098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105844098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:45.500121 run osmo-stp_10.42.42.5(pid=29126): stdout: | (launched: 2022-12-09_10:58:43.929269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:45.620656 run osmo-stp_10.42.42.5(pid=29126): stderr: | 20221209105844097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105844097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105844097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105844097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105844098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105844098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105844098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:45.765300 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29126): Process ended prematurely: osmo-stp_10.42.42.5(pid=29126) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29126)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:58:45.774325 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:58:45.800845 run osmo-hlr_10.42.42.2(pid=29123): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29123)] 10:58:45.848649 run osmo-hlr_10.42.42.2(pid=29123): stdout: | (launched: 2022-12-09_10:58:42.987939) 10:58:45.907800 run osmo-hlr_10.42.42.2(pid=29123): stderr: | 20221209105843160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105843160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105843160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105843160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105843160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105843160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105843173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105843181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105843181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105843182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:45.977906 run osmo-msc_10.42.42.6(pid=29129): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29129)] 10:58:46.025559 run osmo-msc_10.42.42.6(pid=29129): stdout: | (launched: 2022-12-09_10:58:44.893442) 10:58:46.075607 run osmo-msc_10.42.42.6(pid=29129): stderr: | 20221209105845162 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105845162 DLGLOBAL DEBUG validating counter group 0x7f208e69dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105845162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105845162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105845162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105845162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105845164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105845164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105845165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105845165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:46.131735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29122): Terminating (SIGTERM) 10:58:46.176462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29125): Terminating (SIGTERM) 10:58:46.222932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29128): Terminating (SIGTERM) 10:58:46.269420 --- ParallelTerminationStrategy: PID 29122 died... 10:58:46.290649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29122): Terminated: ok {rc=0} 10:58:46.344921 --- ParallelTerminationStrategy: PID 29125 died... 10:58:46.365725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29125): Terminated: ok {rc=0} 10:58:46.415184 --- ParallelTerminationStrategy: PID 29128 died... 10:58:46.436704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29128): Terminated: ok {rc=0} 10:58:46.538836 bus /sierra_3: Setting Powered False 10:58:47.640743 bus /sierra_3: Setting Powered False 10:58:48.756383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:58:49.901052 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:49.912833 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:58:49.979349 tst mo_mt_call_osmux.py: using LAC 20994 10:58:50.097843 tst mo_mt_call_osmux.py: using RAC 84 10:58:50.221157 tst mo_mt_call_osmux.py: using CellId 20994 10:58:50.339066 tst mo_mt_call_osmux.py: using BVCI 20995 10:58:50.447761 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:50.459077 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:50.470135 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:50.481277 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:50.492464 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:58:50.503640 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:58:50.621430 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:58:50.739692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:51.212419 run create_hlr_db(pid=29131): Launched 10:58:51.336694 bus /sierra_2: Setting Powered False 10:58:52.401608 run create_hlr_db(pid=29131): Terminated: ok {rc=0} 10:58:52.852153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29133): Launched 10:58:53.178257 run osmo-hlr_10.42.42.2(pid=29134): Launched 10:58:53.302067 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:53.858989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29136): Launched 10:58:54.182321 run osmo-stp_10.42.42.5(pid=29137): Launched 10:58:54.307156 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:54.893695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29139): Launched 10:58:55.218929 run osmo-msc_10.42.42.6(pid=29140): Launched 10:58:55.400381 run osmo-stp_10.42.42.5(pid=29137): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29137)] 10:58:55.537350 run osmo-stp_10.42.42.5(pid=29137): stdout: | (launched: 2022-12-09_10:58:54.123189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:55.674706 run osmo-stp_10.42.42.5(pid=29137): stderr: | 20221209105854310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105854310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105854310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105854311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105854311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105854311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105854311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:55.810135 run osmo-stp_10.42.42.5(pid=29137): stdout: | (launched: 2022-12-09_10:58:54.123189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:55.940164 run osmo-stp_10.42.42.5(pid=29137): stderr: | 20221209105854310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105854310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105854310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105854311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105854311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105854311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105854311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:56.095392 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29137): Process ended prematurely: osmo-stp_10.42.42.5(pid=29137) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29137)] [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:58:56.105154 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:58:56.133758 run osmo-hlr_10.42.42.2(pid=29134): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29134)] 10:58:56.183879 run osmo-hlr_10.42.42.2(pid=29134): stdout: | (launched: 2022-12-09_10:58:53.119155) 10:58:56.235785 run osmo-hlr_10.42.42.2(pid=29134): stderr: | 20221209105853311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105853311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105853311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105853311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105853311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105853311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105853322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105853331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105853332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105853332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:56.308081 run osmo-msc_10.42.42.6(pid=29140): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29140)] 10:58:56.358147 run osmo-msc_10.42.42.6(pid=29140): stdout: | (launched: 2022-12-09_10:58:55.159069) 10:58:56.409831 run osmo-msc_10.42.42.6(pid=29140): stderr: | 20221209105855477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105855477 DLGLOBAL DEBUG validating counter group 0x7f470b848c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105855477 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105855477 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105855478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105855478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105855479 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105855480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105855480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105855480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:56.461898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29133): Terminating (SIGTERM) 10:58:56.504059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29136): Terminating (SIGTERM) 10:58:56.546397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29139): Terminating (SIGTERM) 10:58:56.588902 --- ParallelTerminationStrategy: PID 29133 died... 10:58:56.609061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29133): Terminated: ok {rc=0} 10:58:56.655867 --- ParallelTerminationStrategy: PID 29136 died... 10:58:56.675448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29136): Terminated: ok {rc=0} 10:58:56.722169 --- ParallelTerminationStrategy: PID 29139 died... 10:58:56.741900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29139): Terminated: ok {rc=0} 10:58:56.830140 bus /sierra_3: Setting Powered False 10:58:57.929646 bus /sierra_3: Setting Powered False 10:58:59.045955 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:59:00.294184 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:00.301994 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:59:00.334324 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:59:00.360482 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:59:00.411896 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:59:00.443742 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:59:00.469953 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:59:01.031034 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:59:01.082255 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:01.094191 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:59:01.161398 tst mo_mt_call.py: using LAC 20995 10:59:01.291791 tst mo_mt_call.py: using RAC 85 10:59:01.422568 tst mo_mt_call.py: using CellId 20995 10:59:01.546094 tst mo_mt_call.py: using BVCI 20996 10:59:01.694210 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:01.708769 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:01.723561 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:01.737475 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:01.751608 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:01.765398 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:59:01.923539 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:59:02.095270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:02.571286 run create_hlr_db(pid=29145): Launched 10:59:02.695674 bus /sierra_2: Setting Powered False 10:59:03.757102 run create_hlr_db(pid=29145): Terminated: ok {rc=0} 10:59:04.200772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29147): Launched 10:59:04.525718 run osmo-hlr_10.42.42.2(pid=29148): Launched 10:59:04.651139 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:05.217233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29150): Launched 10:59:05.541217 run osmo-stp_10.42.42.5(pid=29151): Launched 10:59:05.665350 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:06.250812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29153): Launched 10:59:06.574609 run osmo-msc_10.42.42.6(pid=29154): Launched 10:59:06.756693 run osmo-stp_10.42.42.5(pid=29151): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29151)] 10:59:06.894475 run osmo-stp_10.42.42.5(pid=29151): stdout: | (launched: 2022-12-09_10:59:05.481904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:07.031900 run osmo-stp_10.42.42.5(pid=29151): stderr: | 20221209105905670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105905670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105905670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105905670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105905671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105905671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105905671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:07.167496 run osmo-stp_10.42.42.5(pid=29151): stdout: | (launched: 2022-12-09_10:59:05.481904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:07.296821 run osmo-stp_10.42.42.5(pid=29151): stderr: | 20221209105905670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105905670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105905670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105905670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105905671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105905671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105905671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:07.452404 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29151): Process ended prematurely: osmo-stp_10.42.42.5(pid=29151) [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29151)] [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:59:07.462445 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:59:07.491459 run osmo-hlr_10.42.42.2(pid=29148): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29148)] 10:59:07.542158 run osmo-hlr_10.42.42.2(pid=29148): stdout: | (launched: 2022-12-09_10:59:04.465869) 10:59:07.594521 run osmo-hlr_10.42.42.2(pid=29148): stderr: | 20221209105904660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105904660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105904660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105904660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105904660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105904660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105904673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105904682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105904683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105904683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:07.667139 run osmo-msc_10.42.42.6(pid=29154): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29154)] 10:59:07.717497 run osmo-msc_10.42.42.6(pid=29154): stdout: | (launched: 2022-12-09_10:59:06.515330) 10:59:07.769491 run osmo-msc_10.42.42.6(pid=29154): stderr: | 20221209105906833 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105906833 DLGLOBAL DEBUG validating counter group 0x7f76a0d28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105906833 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105906833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105906833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105906834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105906835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105906836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105906836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105906836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:07.821785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29147): Terminating (SIGTERM) 10:59:07.864548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29150): Terminating (SIGTERM) 10:59:07.906980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29153): Terminating (SIGTERM) 10:59:07.949608 --- ParallelTerminationStrategy: PID 29147 died... 10:59:07.969755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29147): Terminated: ok {rc=0} 10:59:08.016652 --- ParallelTerminationStrategy: PID 29150 died... 10:59:08.036355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29150): Terminated: ok {rc=0} 10:59:08.083229 --- ParallelTerminationStrategy: PID 29153 died... 10:59:08.102827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29153): Terminated: ok {rc=0} 10:59:08.191324 bus /sierra_3: Setting Powered False 10:59:09.290937 bus /sierra_3: Setting Powered False 10:59:10.408256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:59:11.558881 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:11.571384 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:59:11.641848 tst mo_mt_call_osmux.py: using LAC 20996 10:59:11.761982 tst mo_mt_call_osmux.py: using RAC 86 10:59:11.881556 tst mo_mt_call_osmux.py: using CellId 20996 10:59:12.009876 tst mo_mt_call_osmux.py: using BVCI 20997 10:59:12.129501 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:12.141722 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:12.154044 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:12.165739 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:12.178273 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:59:12.190268 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:59:12.305234 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:59:12.426049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:12.930827 run create_hlr_db(pid=29156): Launched 10:59:13.055559 bus /sierra_2: Setting Powered False 10:59:14.119266 run create_hlr_db(pid=29156): Terminated: ok {rc=0} 10:59:14.553147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29158): Launched 10:59:14.855867 run osmo-hlr_10.42.42.2(pid=29159): Launched 10:59:14.970491 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:15.514777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29161): Launched 10:59:15.815985 run osmo-stp_10.42.42.5(pid=29162): Launched 10:59:15.984883 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:16.683854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29164): Launched 10:59:17.004719 run osmo-msc_10.42.42.6(pid=29165): Launched 10:59:17.293722 run osmo-stp_10.42.42.5(pid=29162): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29162)] 10:59:17.421313 run osmo-stp_10.42.42.5(pid=29162): stdout: | (launched: 2022-12-09_10:59:15.760292) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:17.551488 run osmo-stp_10.42.42.5(pid=29162): stderr: | 20221209105916041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105916042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105916042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105916042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105916043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105916043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105916043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:17.677615 run osmo-stp_10.42.42.5(pid=29162): stdout: | (launched: 2022-12-09_10:59:15.760292) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:17.798287 run osmo-stp_10.42.42.5(pid=29162): stderr: | 20221209105916041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105916042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105916042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105916042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105916043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105916043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105916043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:17.943054 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29162): Process ended prematurely: osmo-stp_10.42.42.5(pid=29162) [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29162)] [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:59:17.952192 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:59:17.979154 run osmo-hlr_10.42.42.2(pid=29159): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29159)] 10:59:18.026782 run osmo-hlr_10.42.42.2(pid=29159): stdout: | (launched: 2022-12-09_10:59:14.799773) 10:59:18.076093 run osmo-hlr_10.42.42.2(pid=29159): stderr: | 20221209105914972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105914972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105914972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105914973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105914973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105914973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105914985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105914993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105914993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105914993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:18.144672 run osmo-msc_10.42.42.6(pid=29165): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29165)] 10:59:18.193194 run osmo-msc_10.42.42.6(pid=29165): stdout: | (launched: 2022-12-09_10:59:16.943414) 10:59:18.242099 run osmo-msc_10.42.42.6(pid=29165): stderr: | 20221209105917394 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105917394 DLGLOBAL DEBUG validating counter group 0x7faa5a148c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105917394 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105917394 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105917395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105917395 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105917397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105917397 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105917397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105917397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:18.291453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29158): Terminating (SIGTERM) 10:59:18.330760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29161): Terminating (SIGTERM) 10:59:18.370129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29164): Terminating (SIGTERM) 10:59:18.410658 --- ParallelTerminationStrategy: PID 29158 died... 10:59:18.429770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29158): Terminated: ok {rc=0} 10:59:18.473786 --- ParallelTerminationStrategy: PID 29161 died... 10:59:18.492572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29161): Terminated: ok {rc=0} 10:59:18.536122 --- ParallelTerminationStrategy: PID 29164 died... 10:59:18.554899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29164): Terminated: ok {rc=0} 10:59:18.640188 bus /sierra_3: Setting Powered False 10:59:19.740181 bus /sierra_3: Setting Powered False 10:59:20.854106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:59:22.110103 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:22.118330 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:59:22.150178 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:59:22.176432 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:59:22.227912 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:59:22.259783 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:59:22.286322 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:59:22.838868 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:59:22.887419 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:22.898751 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:59:22.948036 tst mo_mt_call.py: using LAC 20997 10:59:23.067851 tst mo_mt_call.py: using RAC 87 10:59:23.188452 tst mo_mt_call.py: using CellId 20997 10:59:23.309689 tst mo_mt_call.py: using BVCI 20998 10:59:23.419676 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:23.431087 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:23.442246 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:23.453333 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:23.464465 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:23.475647 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:59:23.595691 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:59:23.711124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:24.182333 run create_hlr_db(pid=29170): Launched 10:59:24.307369 bus /sierra_2: Setting Powered False 10:59:25.368288 run create_hlr_db(pid=29170): Terminated: ok {rc=0} 10:59:25.791023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29172): Launched 10:59:26.095348 run osmo-hlr_10.42.42.2(pid=29173): Launched 10:59:26.211357 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:26.742637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29175): Launched 10:59:27.045243 run osmo-stp_10.42.42.5(pid=29176): Launched 10:59:27.160267 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:27.703387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29178): Launched 10:59:28.003501 run osmo-msc_10.42.42.6(pid=29179): Launched 10:59:28.172086 run osmo-stp_10.42.42.5(pid=29176): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29176)] 10:59:28.299024 run osmo-stp_10.42.42.5(pid=29176): stdout: | (launched: 2022-12-09_10:59:26.989789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:28.425422 run osmo-stp_10.42.42.5(pid=29176): stderr: | 20221209105927156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105927156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105927157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105927157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105927158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105927158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105927158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:28.550539 run osmo-stp_10.42.42.5(pid=29176): stdout: | (launched: 2022-12-09_10:59:26.989789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:28.670432 run osmo-stp_10.42.42.5(pid=29176): stderr: | 20221209105927156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105927156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105927157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105927157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105927158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105927158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105927158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:28.813477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29176): Process ended prematurely: osmo-stp_10.42.42.5(pid=29176) [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29176)] [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:59:28.822400 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:59:28.848850 run osmo-hlr_10.42.42.2(pid=29173): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29173)] 10:59:28.896069 run osmo-hlr_10.42.42.2(pid=29173): stdout: | (launched: 2022-12-09_10:59:26.038965) 10:59:28.945320 run osmo-hlr_10.42.42.2(pid=29173): stderr: | 20221209105926212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105926212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105926212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105926212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105926212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105926212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105926224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105926232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105926233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105926233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:29.013997 run osmo-msc_10.42.42.6(pid=29179): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29179)] 10:59:29.061386 run osmo-msc_10.42.42.6(pid=29179): stdout: | (launched: 2022-12-09_10:59:27.948049) 10:59:29.111025 run osmo-msc_10.42.42.6(pid=29179): stderr: | 20221209105928215 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105928215 DLGLOBAL DEBUG validating counter group 0x7f567c2d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105928215 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105928215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105928215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105928215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105928217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105928218 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105928218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105928218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:29.160659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29172): Terminating (SIGTERM) 10:59:29.200275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29175): Terminating (SIGTERM) 10:59:29.239648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29178): Terminating (SIGTERM) 10:59:29.279384 --- ParallelTerminationStrategy: PID 29172 died... 10:59:29.298491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29172): Terminated: ok {rc=0} 10:59:29.342136 --- ParallelTerminationStrategy: PID 29175 died... 10:59:29.360508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29175): Terminated: ok {rc=0} 10:59:29.404383 --- ParallelTerminationStrategy: PID 29178 died... 10:59:29.422811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29178): Terminated: ok {rc=0} 10:59:29.508769 bus /sierra_3: Setting Powered False 10:59:30.608218 bus /sierra_3: Setting Powered False 10:59:31.726293 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:59:32.871404 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:32.883342 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:59:32.933422 tst mo_mt_call_osmux.py: using LAC 20998 10:59:33.052738 tst mo_mt_call_osmux.py: using RAC 88 10:59:33.171223 tst mo_mt_call_osmux.py: using CellId 20998 10:59:33.291269 tst mo_mt_call_osmux.py: using BVCI 20999 10:59:33.401970 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:33.413301 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:33.424690 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:33.435814 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:33.447047 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:59:33.458180 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:59:33.578116 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:59:33.701361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:34.205608 run create_hlr_db(pid=29182): Launched 10:59:34.332156 bus /sierra_2: Setting Powered False 10:59:35.396913 run create_hlr_db(pid=29182): Terminated: ok {rc=0} 10:59:35.829478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29184): Launched 10:59:36.133758 run osmo-hlr_10.42.42.2(pid=29185): Launched 10:59:36.249327 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:36.778358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29187): Launched 10:59:37.082440 run osmo-stp_10.42.42.5(pid=29188): Launched 10:59:37.198905 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:37.744875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29190): Launched 10:59:38.047432 run osmo-msc_10.42.42.6(pid=29191): Launched 10:59:38.218021 run osmo-stp_10.42.42.5(pid=29188): ERR: Terminated: ERROR {rc=1} [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29188)] 10:59:38.345293 run osmo-stp_10.42.42.5(pid=29188): stdout: | (launched: 2022-12-09_10:59:37.026537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:38.472541 run osmo-stp_10.42.42.5(pid=29188): stderr: | 20221209105937193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105937194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105937194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105937194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105937195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105937195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105937195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:38.597959 run osmo-stp_10.42.42.5(pid=29188): stdout: | (launched: 2022-12-09_10:59:37.026537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:38.718533 run osmo-stp_10.42.42.5(pid=29188): stderr: | 20221209105937193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105937194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105937194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105937194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105937195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105937195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105937195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:38.862926 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29188): Process ended prematurely: osmo-stp_10.42.42.5(pid=29188) [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29188)] [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:59:38.872060 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:59:38.899034 run osmo-hlr_10.42.42.2(pid=29185): ERR: Terminated: ERROR {rc=237} [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29185)] 10:59:38.946770 run osmo-hlr_10.42.42.2(pid=29185): stdout: | (launched: 2022-12-09_10:59:36.077724) 10:59:38.996020 run osmo-hlr_10.42.42.2(pid=29185): stderr: | 20221209105936250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105936250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105936250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105936250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105936250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105936250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105936262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105936270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105936270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105936271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:39.065030 run osmo-msc_10.42.42.6(pid=29191): ERR: Terminated: ERROR {rc=2} [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29191)] 10:59:39.112600 run osmo-msc_10.42.42.6(pid=29191): stdout: | (launched: 2022-12-09_10:59:37.991145) 10:59:39.161706 run osmo-msc_10.42.42.6(pid=29191): stderr: | 20221209105938258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105938258 DLGLOBAL DEBUG validating counter group 0x7fc20c38ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105938258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105938258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105938258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105938258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105938260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105938261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105938261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105938261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:39.211992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29184): Terminating (SIGTERM) 10:59:39.252306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29187): Terminating (SIGTERM) 10:59:39.292130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29190): Terminating (SIGTERM) 10:59:39.332139 --- ParallelTerminationStrategy: PID 29184 died... 10:59:39.351402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29184): Terminated: ok {rc=0} 10:59:39.395716 --- ParallelTerminationStrategy: PID 29187 died... 10:59:39.414377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29187): Terminated: ok {rc=0} 10:59:39.458651 --- ParallelTerminationStrategy: PID 29190 died... 10:59:39.477458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29190): Terminated: ok {rc=0} 10:59:39.563575 bus /sierra_3: Setting Powered False 10:59:40.664266 bus /sierra_3: Setting Powered False 10:59:41.777432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 emergency:nanobts+band-900 --------------------------------------------------------------------- 10:59:43.036451 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:43.041941 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:59:43.073319 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:59:43.099581 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 10:59:43.180802 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:59:43.212569 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:59:43.238798 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 10:59:43.823167 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2358 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 10:59:43.828264 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:43.839114 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 10:59:43.886959 tst emergency_mo_mt_call.py: using LAC 20999 10:59:44.003747 tst emergency_mo_mt_call.py: using RAC 89 10:59:44.118153 tst emergency_mo_mt_call.py: using CellId 20999 10:59:44.232504 tst emergency_mo_mt_call.py: using BVCI 21000 10:59:44.339695 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:44.350616 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:44.361065 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:44.371560 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:44.382059 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:44.392393 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:59:44.510496 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:59:44.629340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:45.124149 run create_hlr_db(pid=29196): Launched 10:59:45.246048 bus /sierra_2: Setting Powered False 10:59:46.309135 run create_hlr_db(pid=29196): Terminated: ok {rc=0} 10:59:46.759684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29198): Launched 10:59:47.094261 run osmo-hlr_10.42.42.2(pid=29199): Launched 10:59:47.241882 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:47.791081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29201): Launched 10:59:48.112098 run osmo-stp_10.42.42.5(pid=29202): Launched 10:59:48.244304 tst emergency_mo_mt_call.py: using MSISDN 7168 10:59:48.411269 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:48.985323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29204): Launched 10:59:49.304366 run osmo-msc_10.42.42.6(pid=29205): Launched 10:59:49.483415 run osmo-stp_10.42.42.5(pid=29202): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29202)] 10:59:49.618466 run osmo-stp_10.42.42.5(pid=29202): stdout: | (launched: 2022-12-09_10:59:48.053306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:49.753204 run osmo-stp_10.42.42.5(pid=29202): stderr: | 20221209105948241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105948241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105948242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105948242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105948243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105948243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105948243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:49.887540 run osmo-stp_10.42.42.5(pid=29202): stdout: | (launched: 2022-12-09_10:59:48.053306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:50.014672 run osmo-stp_10.42.42.5(pid=29202): stderr: | 20221209105948241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105948241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105948242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105948242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105948243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105948243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105948243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:50.166573 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29202): Process ended prematurely: osmo-stp_10.42.42.5(pid=29202) [trial-2358↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29202)] [trial-2358↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 10:59:50.175744 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 10:59:50.204391 run osmo-hlr_10.42.42.2(pid=29199): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29199)] 10:59:50.255603 run osmo-hlr_10.42.42.2(pid=29199): stdout: | (launched: 2022-12-09_10:59:47.036221) 10:59:50.308069 run osmo-hlr_10.42.42.2(pid=29199): stderr: | 20221209105947251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105947251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105947251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105947251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105947252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105947252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105947263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105947272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105947272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105947272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:50.381575 run osmo-msc_10.42.42.6(pid=29205): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29205)] 10:59:50.432550 run osmo-msc_10.42.42.6(pid=29205): stdout: | (launched: 2022-12-09_10:59:49.245377) 10:59:50.485323 run osmo-msc_10.42.42.6(pid=29205): stderr: | 20221209105949565 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105949565 DLGLOBAL DEBUG validating counter group 0x7f4ba9c6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105949565 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105949566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105949566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105949566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105949568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105949568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105949568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105949568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:50.538356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29198): Terminating (SIGTERM) 10:59:50.581101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29201): Terminating (SIGTERM) 10:59:50.623633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29204): Terminating (SIGTERM) 10:59:50.666566 --- ParallelTerminationStrategy: PID 29198 died... 10:59:50.686930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29198): Terminated: ok {rc=0} 10:59:50.734448 --- ParallelTerminationStrategy: PID 29201 died... 10:59:50.754581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29201): Terminated: ok {rc=0} 10:59:50.801754 --- ParallelTerminationStrategy: PID 29204 died... 10:59:50.821547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29204): Terminated: ok {rc=0} 10:59:50.911945 bus /sierra_3: Setting Powered False 10:59:52.011909 bus /sierra_3: Setting Powered False 10:59:53.129507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 10:59:54.217673 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:54.229660 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 10:59:54.281461 tst emergency_preemptive_call.py: using LAC 21000 10:59:54.407801 tst emergency_preemptive_call.py: using RAC 90 10:59:54.533162 tst emergency_preemptive_call.py: using CellId 21000 10:59:54.651426 tst emergency_preemptive_call.py: using BVCI 21001 10:59:54.761100 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:54.771914 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:54.782584 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:54.793231 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:54.804043 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:54.814501 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:59:54.933341 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:59:55.048504 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:59:55.165462 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:59:55.280346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:55.747395 run create_hlr_db(pid=29207): Launched 10:59:55.872324 bus /sierra_2: Setting Powered False 10:59:56.933146 run create_hlr_db(pid=29207): Terminated: ok {rc=0} 10:59:57.351765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29209): Launched 10:59:57.651103 run osmo-hlr_10.42.42.2(pid=29210): Launched 10:59:57.764729 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:58.289605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29212): Launched 10:59:58.589756 run osmo-stp_10.42.42.5(pid=29213): Launched 10:59:58.713403 tst emergency_preemptive_call.py: using MSISDN 7169 10:59:58.864303 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:59.401301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29215): Launched 10:59:59.699198 run osmo-msc_10.42.42.6(pid=29216): Launched 10:59:59.865273 run osmo-stp_10.42.42.5(pid=29213): ERR: Terminated: ERROR {rc=1} [trial-2358↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29213)] 10:59:59.990772 run osmo-stp_10.42.42.5(pid=29213): stdout: | (launched: 2022-12-09_10:59:58.534192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:00.116239 run osmo-stp_10.42.42.5(pid=29213): stderr: | 20221209105958700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105958701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105958701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105958701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105958702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105958702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105958702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:00.240179 run osmo-stp_10.42.42.5(pid=29213): stdout: | (launched: 2022-12-09_10:59:58.534192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:00.358284 run osmo-stp_10.42.42.5(pid=29213): stderr: | 20221209105958700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209105958701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209105958701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209105958701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209105958702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209105958702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209105958702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:00.499608 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29213): Process ended prematurely: osmo-stp_10.42.42.5(pid=29213) [trial-2358↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29213)] [trial-2358↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 11:00:00.508481 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 11:00:00.535475 run osmo-hlr_10.42.42.2(pid=29210): ERR: Terminated: ERROR {rc=237} [trial-2358↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29210)] 11:00:00.583546 run osmo-hlr_10.42.42.2(pid=29210): stdout: | (launched: 2022-12-09_10:59:57.595815) 11:00:00.633736 run osmo-hlr_10.42.42.2(pid=29210): stderr: | 20221209105957771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209105957771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209105957771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209105957771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209105957771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209105957771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209105957783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209105957793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209105957793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209105957793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:00.703769 run osmo-msc_10.42.42.6(pid=29216): ERR: Terminated: ERROR {rc=2} [trial-2358↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29216)] 11:00:00.751629 run osmo-msc_10.42.42.6(pid=29216): stdout: | (launched: 2022-12-09_10:59:59.643979) 11:00:00.801351 run osmo-msc_10.42.42.6(pid=29216): stderr: | 20221209105959912 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209105959913 DLGLOBAL DEBUG validating counter group 0x7f08b8bf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209105959913 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209105959913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209105959913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209105959913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209105959915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209105959915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209105959917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209105959917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:00.869678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29209): Terminating (SIGTERM) 11:00:00.923982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29212): Terminating (SIGTERM) 11:00:00.971439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29215): Terminating (SIGTERM) 11:00:01.020297 --- ParallelTerminationStrategy: PID 29209 died... 11:00:01.053311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29209): Terminated: ok {rc=0} 11:00:01.118815 --- ParallelTerminationStrategy: PID 29212 died... 11:00:01.140758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29212): Terminated: ok {rc=0} 11:00:01.191142 --- ParallelTerminationStrategy: PID 29215 died... 11:00:01.212209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29215): Terminated: ok {rc=0} 11:00:01.324497 bus /sierra_9: Setting Powered False 11:00:02.428904 bus /sierra_9: Setting Powered False 11:00:03.546148 bus /sierra_8: Setting Powered False 11:00:04.645497 bus /sierra_8: Setting Powered False 11:00:05.764609 bus /sierra_3: Setting Powered False 11:00:06.864099 bus /sierra_3: Setting Powered False 11:00:07.980461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900 --------------------------------------------------------------------- 11:00:09.260253 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:09.265493 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:00:09.297392 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 11:00:09.335029 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 11:00:09.419892 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:00:09.451754 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 11:00:09.489487 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 11:00:10.085464 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 11:00:10.139622 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.150928 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:00:10.199550 tst cs_paging_gprs_active.py: using LAC 21001 11:00:10.321259 tst cs_paging_gprs_active.py: using RAC 91 11:00:10.443826 tst cs_paging_gprs_active.py: using CellId 21001 11:00:10.573215 tst cs_paging_gprs_active.py: using BVCI 21002 11:00:10.693477 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.704689 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.715812 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.727524 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.738708 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.749869 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.761195 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.772069 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:10.783307 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:10.900669 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:11.018133 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:00:11.221813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:11.527833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29226): Launched 11:00:11.794224 run iperf3-srv_10.42.42.10(pid=29227): Launched 11:00:11.911243 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:00:12.114018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:12.434804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29228): Launched 11:00:12.718830 run iperf3-srv_10.42.42.10(pid=29229): Launched 11:00:12.842598 tst cs_paging_gprs_active.py:38: start network... 11:00:13.062579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:13.567753 run create_hlr_db(pid=29230): Launched 11:00:13.693000 bus /sierra_2: Setting Powered False 11:00:14.756921 run create_hlr_db(pid=29230): Terminated: ok {rc=0} 11:00:15.209615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29232): Launched 11:00:15.538238 run osmo-hlr_10.42.42.2(pid=29233): Launched 11:00:15.663614 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:16.243013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29235): Launched 11:00:16.584418 run osmo-stp_10.42.42.5(pid=29236): Launched 11:00:16.964309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:17.544917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29238): Launched 11:00:17.660900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:17.917724 run patchelf(pid=29239): Launched 11:00:18.086352 run osmo-stp_10.42.42.5(pid=29236): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29236)] 11:00:18.214359 run osmo-stp_10.42.42.5(pid=29236): stdout: | (launched: 2022-12-09_11:00:16.523349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:18.343728 run osmo-stp_10.42.42.5(pid=29236): stderr: | 20221209110016823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110016823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110016824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110016825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110016827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110016827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110016827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:18.473158 run osmo-stp_10.42.42.5(pid=29236): stdout: | (launched: 2022-12-09_11:00:16.523349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:18.597374 run osmo-stp_10.42.42.5(pid=29236): stderr: | 20221209110016823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110016823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110016824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110016825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110016827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110016827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110016827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:18.744248 run patchelf(pid=29239): Terminating (SIGINT) 11:00:18.914928 run patchelf(pid=29239): Terminated: ok {rc=0} 11:00:19.037259 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29236): Process ended prematurely: osmo-stp_10.42.42.5(pid=29236) [trial-2358↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29236)] [trial-2358↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 11:00:19.046772 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:00:19.074215 run osmo-hlr_10.42.42.2(pid=29233): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29233)] 11:00:19.121773 run osmo-hlr_10.42.42.2(pid=29233): stdout: | (launched: 2022-12-09_11:00:15.477976) 11:00:19.171143 run osmo-hlr_10.42.42.2(pid=29233): stderr: | 20221209110015673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110015673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110015673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110015673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110015673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110015673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110015686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110015695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110015695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110015695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:19.220858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29226): Terminating (SIGTERM) 11:00:19.260755 run iperf3-srv_10.42.42.10(pid=29227): Terminating (SIGTERM) 11:00:19.300180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29228): Terminating (SIGTERM) 11:00:19.339723 run iperf3-srv_10.42.42.10(pid=29229): Terminating (SIGTERM) 11:00:19.379054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29232): Terminating (SIGTERM) 11:00:19.418591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29235): Terminating (SIGTERM) 11:00:19.458046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29238): Terminating (SIGTERM) 11:00:19.498594 --- ParallelTerminationStrategy: PID 29226 died... 11:00:19.517849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29226): Terminated: ok {rc=0} 11:00:19.561947 --- ParallelTerminationStrategy: PID 29227 died... 11:00:19.580472 run iperf3-srv_10.42.42.10(pid=29227): Terminated {rc=256} 11:00:19.624156 --- ParallelTerminationStrategy: PID 29228 died... 11:00:19.643311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29228): Terminated: ok {rc=0} 11:00:19.686967 --- ParallelTerminationStrategy: PID 29229 died... 11:00:19.705643 run iperf3-srv_10.42.42.10(pid=29229): Terminated {rc=256} 11:00:19.749383 --- ParallelTerminationStrategy: PID 29232 died... 11:00:19.768023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29232): Terminated: ok {rc=0} 11:00:19.811727 --- ParallelTerminationStrategy: PID 29235 died... 11:00:19.830665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29235): Terminated: ok {rc=0} 11:00:19.874293 --- ParallelTerminationStrategy: PID 29238 died... 11:00:19.893137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29238): Terminated: ok {rc=0} 11:00:19.976901 bus /gobi_0: Setting Powered False 11:00:21.073873 bus /gobi_0: Setting Powered False 11:00:22.188900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 11:00:23.338301 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.350029 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:00:23.402416 tst iperf3.py: using LAC 21002 11:00:23.533796 tst iperf3.py: using RAC 92 11:00:23.661134 tst iperf3.py: using CellId 21002 11:00:23.786430 tst iperf3.py: using BVCI 21003 11:00:23.904521 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.915773 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.926781 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.938124 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.949266 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.960266 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.971558 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.982703 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:23.993983 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:24.113045 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:00:24.333377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:24.660191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29240): Launched 11:00:24.944072 run iperf3-srv_10.42.42.10(pid=29241): Launched 11:00:25.068182 tst iperf3.py:8: start network... 11:00:25.286380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:25.790325 run create_hlr_db(pid=29242): Launched 11:00:25.915745 bus /gobi_6: Setting Powered False 11:00:26.979966 run create_hlr_db(pid=29242): Terminated: ok {rc=0} 11:00:27.413033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29244): Launched 11:00:27.718052 run osmo-hlr_10.42.42.2(pid=29245): Launched 11:00:27.833601 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:28.357063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29247): Launched 11:00:28.659974 run osmo-stp_10.42.42.5(pid=29248): Launched 11:00:28.775307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:29.297515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29250): Launched 11:00:29.413491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:29.671289 run patchelf(pid=29251): Launched 11:00:29.839452 run osmo-stp_10.42.42.5(pid=29248): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29248)] 11:00:29.978912 run osmo-stp_10.42.42.5(pid=29248): stdout: | (launched: 2022-12-09_11:00:28.604069) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:30.117892 run osmo-stp_10.42.42.5(pid=29248): stderr: | 20221209110028772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110028772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110028773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110028773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110028774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110028774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110028774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:30.257271 run osmo-stp_10.42.42.5(pid=29248): stdout: | (launched: 2022-12-09_11:00:28.604069) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:30.391167 run osmo-stp_10.42.42.5(pid=29248): stderr: | 20221209110028772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110028772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110028773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110028773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110028774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110028774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110028774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:30.549499 run patchelf(pid=29251): Terminating (SIGINT) 11:00:30.732011 run patchelf(pid=29251): Terminated: ok {rc=0} 11:00:30.878359 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29248): Process ended prematurely: osmo-stp_10.42.42.5(pid=29248) [trial-2358↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29248)] [trial-2358↪gprs:nanobts+band-900↪iperf3.py:8] 11:00:30.890024 tst iperf3.py:8: Test FAILED (7.6 sec) 11:00:30.921389 run osmo-hlr_10.42.42.2(pid=29245): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29245)] 11:00:30.973837 run osmo-hlr_10.42.42.2(pid=29245): stdout: | (launched: 2022-12-09_11:00:27.661293) 11:00:31.028652 run osmo-hlr_10.42.42.2(pid=29245): stderr: | 20221209110027835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110027835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110027835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110027835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110027835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110027835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110027884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110027893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110027894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110027894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:31.083814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29240): Terminating (SIGTERM) 11:00:31.128828 run iperf3-srv_10.42.42.10(pid=29241): Terminating (SIGTERM) 11:00:31.174854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29244): Terminating (SIGTERM) 11:00:31.219939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29247): Terminating (SIGTERM) 11:00:31.266351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29250): Terminating (SIGTERM) 11:00:31.312761 --- ParallelTerminationStrategy: PID 29240 died... 11:00:31.333911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29240): Terminated: ok {rc=0} 11:00:31.385038 --- ParallelTerminationStrategy: PID 29241 died... 11:00:31.405696 run iperf3-srv_10.42.42.10(pid=29241): Terminated {rc=256} 11:00:31.455288 --- ParallelTerminationStrategy: PID 29244 died... 11:00:31.475909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29244): Terminated: ok {rc=0} 11:00:31.525610 --- ParallelTerminationStrategy: PID 29247 died... 11:00:31.546177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29247): Terminated: ok {rc=0} 11:00:31.596228 --- ParallelTerminationStrategy: PID 29250 died... 11:00:31.616672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29250): Terminated: ok {rc=0} 11:00:31.710168 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 11:00:32.862966 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:32.874723 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:00:32.922757 tst iperf3m4.py: using LAC 21003 11:00:33.054796 tst iperf3m4.py: using RAC 93 11:00:33.181737 tst iperf3m4.py: using CellId 21003 11:00:33.309157 tst iperf3m4.py: using BVCI 21004 11:00:33.426490 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.437737 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.448627 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.459889 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.471095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.482324 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.493823 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.504760 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:33.516219 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:33.636512 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:33.754623 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:33.874208 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:33.991407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:00:34.193836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:34.497875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29252): Launched 11:00:34.782853 run iperf3-srv_10.42.42.10(pid=29253): Launched 11:00:34.907103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:00:35.125057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:35.451340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29254): Launched 11:00:35.735747 run iperf3-srv_10.42.42.10(pid=29255): Launched 11:00:35.857743 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:00:36.075989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:36.401438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Launched 11:00:36.686113 run iperf3-srv_10.42.42.10(pid=29257): Launched 11:00:36.809399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:00:37.027706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:37.352304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29258): Launched 11:00:37.635700 run iperf3-srv_10.42.42.10(pid=29259): Launched 11:00:37.757869 tst iperf3m4.py:8: start network... 11:00:37.975405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:38.480511 run create_hlr_db(pid=29260): Launched 11:00:38.603956 bus /gobi_6: Setting Powered False 11:00:39.667490 run create_hlr_db(pid=29260): Terminated: ok {rc=0} 11:00:40.119258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29262): Launched 11:00:40.446053 run osmo-hlr_10.42.42.2(pid=29263): Launched 11:00:40.572198 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:41.136846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29265): Launched 11:00:41.462898 run osmo-stp_10.42.42.5(pid=29266): Launched 11:00:41.589091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:42.149831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29268): Launched 11:00:42.273997 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:42.549148 run patchelf(pid=29269): Launched 11:00:42.730221 run osmo-stp_10.42.42.5(pid=29266): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29266)] 11:00:42.867658 run osmo-stp_10.42.42.5(pid=29266): stdout: | (launched: 2022-12-09_11:00:41.403108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:43.007415 run osmo-stp_10.42.42.5(pid=29266): stderr: | 20221209110041592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110041592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110041593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110041593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110041593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110041594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110041594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:43.146749 run osmo-stp_10.42.42.5(pid=29266): stdout: | (launched: 2022-12-09_11:00:41.403108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:43.280026 run osmo-stp_10.42.42.5(pid=29266): stderr: | 20221209110041592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110041592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110041593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110041593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110041593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110041594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110041594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:43.438362 run patchelf(pid=29269): Terminating (SIGINT) 11:00:43.620468 run patchelf(pid=29269): Terminated: ok {rc=0} 11:00:43.752248 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29266): Process ended prematurely: osmo-stp_10.42.42.5(pid=29266) [trial-2358↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29266)] [trial-2358↪gprs:nanobts+band-900↪iperf3m4.py:8] 11:00:43.762652 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:00:43.792209 run osmo-hlr_10.42.42.2(pid=29263): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29263)] 11:00:43.842705 run osmo-hlr_10.42.42.2(pid=29263): stdout: | (launched: 2022-12-09_11:00:40.386297) 11:00:43.895468 run osmo-hlr_10.42.42.2(pid=29263): stderr: | 20221209110040581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110040581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110040581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110040581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110040581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110040581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110040596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110040606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110040606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110040606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:43.948342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29252): Terminating (SIGTERM) 11:00:43.990385 run iperf3-srv_10.42.42.10(pid=29253): Terminating (SIGTERM) 11:00:44.032629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29254): Terminating (SIGTERM) 11:00:44.075041 run iperf3-srv_10.42.42.10(pid=29255): Terminating (SIGTERM) 11:00:44.117296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Terminating (SIGTERM) 11:00:44.159270 run iperf3-srv_10.42.42.10(pid=29257): Terminating (SIGTERM) 11:00:44.201370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29258): Terminating (SIGTERM) 11:00:44.243547 run iperf3-srv_10.42.42.10(pid=29259): Terminating (SIGTERM) 11:00:44.285672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29262): Terminating (SIGTERM) 11:00:44.327750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29265): Terminating (SIGTERM) 11:00:44.369969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29268): Terminating (SIGTERM) 11:00:44.412396 --- ParallelTerminationStrategy: PID 29252 died... 11:00:44.432701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29252): Terminated: ok {rc=0} 11:00:44.479730 --- ParallelTerminationStrategy: PID 29253 died... 11:00:44.499410 run iperf3-srv_10.42.42.10(pid=29253): Terminated {rc=256} 11:00:44.545974 --- ParallelTerminationStrategy: PID 29254 died... 11:00:44.565755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29254): Terminated: ok {rc=0} 11:00:44.612363 --- ParallelTerminationStrategy: PID 29255 died... 11:00:44.631946 run iperf3-srv_10.42.42.10(pid=29255): Terminated {rc=256} 11:00:44.678406 --- ParallelTerminationStrategy: PID 29256 died... 11:00:44.698225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Terminated: ok {rc=0} 11:00:44.744723 --- ParallelTerminationStrategy: PID 29257 died... 11:00:44.764424 run iperf3-srv_10.42.42.10(pid=29257): Terminated {rc=256} 11:00:44.810953 --- ParallelTerminationStrategy: PID 29258 died... 11:00:44.830661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29258): Terminated: ok {rc=0} 11:00:44.877370 --- ParallelTerminationStrategy: PID 29259 died... 11:00:44.896891 run iperf3-srv_10.42.42.10(pid=29259): Terminated {rc=256} 11:00:44.943662 --- ParallelTerminationStrategy: PID 29262 died... 11:00:44.963321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29262): Terminated: ok {rc=0} 11:00:45.009625 --- ParallelTerminationStrategy: PID 29265 died... 11:00:45.029364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29265): Terminated: ok {rc=0} 11:00:45.076148 --- ParallelTerminationStrategy: PID 29268 died... 11:00:45.095957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29268): Terminated: ok {rc=0} 11:00:45.184847 bus /gobi_4: Setting Powered False 11:00:46.284031 bus /gobi_4: Setting Powered False 11:00:47.398445 bus /gobi_1: Setting Powered False 11:00:48.496748 bus /gobi_1: Setting Powered False 11:00:49.611628 bus /gobi_0: Setting Powered False 11:00:50.706919 bus /gobi_0: Setting Powered False 11:00:51.822789 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900 ping.py ---------------------------------------------- 11:00:52.927286 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:52.938533 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:00:52.986256 tst ping.py: using LAC 21004 11:00:53.105042 tst ping.py: using RAC 94 11:00:53.221855 tst ping.py: using CellId 21004 11:00:53.340926 tst ping.py: using BVCI 21005 11:00:53.448559 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.459245 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.469818 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.480369 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.490836 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.501354 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.512027 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:00:53.522698 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:00:53.641599 tst ping.py:19: start network... 11:00:53.856089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:54.349313 run create_hlr_db(pid=29270): Launched 11:00:54.473369 bus /gobi_6: Setting Powered False 11:00:55.536219 run create_hlr_db(pid=29270): Terminated: ok {rc=0} 11:00:55.964155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29272): Launched 11:00:56.262289 run osmo-hlr_10.42.42.2(pid=29273): Launched 11:00:56.374930 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:56.893038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29275): Launched 11:00:57.191320 run osmo-stp_10.42.42.5(pid=29276): Launched 11:00:57.304644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:57.817332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29278): Launched 11:00:57.930957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:58.181900 run patchelf(pid=29279): Launched 11:00:58.347605 run osmo-stp_10.42.42.5(pid=29276): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29276)] 11:00:58.473250 run osmo-stp_10.42.42.5(pid=29276): stdout: | (launched: 2022-12-09_11:00:57.135677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:58.600000 run osmo-stp_10.42.42.5(pid=29276): stderr: | 20221209110057300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110057300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110057301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110057301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110057302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110057302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110057302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:58.726414 run osmo-stp_10.42.42.5(pid=29276): stdout: | (launched: 2022-12-09_11:00:57.135677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:58.848293 run osmo-stp_10.42.42.5(pid=29276): stderr: | 20221209110057300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110057300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110057301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110057301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110057302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110057302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110057302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:58.992743 run patchelf(pid=29279): Terminating (SIGINT) 11:00:59.158925 run patchelf(pid=29279): Terminated: ok {rc=0} 11:00:59.278872 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29276): Process ended prematurely: osmo-stp_10.42.42.5(pid=29276) [trial-2358↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29276)] [trial-2358↪gprs:nanobts+band-900↪ping.py:22] 11:00:59.287734 tst ping.py:22: Test FAILED (6.4 sec) 11:00:59.314740 run osmo-hlr_10.42.42.2(pid=29273): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29273)] 11:00:59.362181 run osmo-hlr_10.42.42.2(pid=29273): stdout: | (launched: 2022-12-09_11:00:56.206827) 11:00:59.411247 run osmo-hlr_10.42.42.2(pid=29273): stderr: | 20221209110056378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110056378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110056378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110056378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110056378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110056378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110056390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110056398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110056399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110056399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:59.461247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29272): Terminating (SIGTERM) 11:00:59.500654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29275): Terminating (SIGTERM) 11:00:59.540302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29278): Terminating (SIGTERM) 11:00:59.580314 --- ParallelTerminationStrategy: PID 29272 died... 11:00:59.599394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29272): Terminated: ok {rc=0} 11:00:59.644081 --- ParallelTerminationStrategy: PID 29275 died... 11:00:59.662979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29275): Terminated: ok {rc=0} 11:00:59.706588 --- ParallelTerminationStrategy: PID 29278 died... 11:00:59.725226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29278): Terminated: ok {rc=0} 11:00:59.810799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 11:01:00.902646 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:00.914948 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:01:00.968252 tst ping_idle_ping.py: using LAC 21005 11:01:01.091680 tst ping_idle_ping.py: using RAC 95 11:01:01.221143 tst ping_idle_ping.py: using CellId 21005 11:01:01.350916 tst ping_idle_ping.py: using BVCI 21006 11:01:01.510883 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.527030 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.544208 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.561054 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.578470 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.591962 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.603830 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:01:01.615271 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:01:01.730752 tst ping_idle_ping.py:24: start network... 11:01:01.952844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:02.458809 run create_hlr_db(pid=29280): Launched 11:01:02.583736 bus /gobi_6: Setting Powered False 11:01:03.647733 run create_hlr_db(pid=29280): Terminated: ok {rc=0} 11:01:04.093352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29282): Launched 11:01:04.415774 run osmo-hlr_10.42.42.2(pid=29283): Launched 11:01:04.538184 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:05.088839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29285): Launched 11:01:05.411196 run osmo-stp_10.42.42.5(pid=29286): Launched 11:01:05.534724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:06.086395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29288): Launched 11:01:06.210020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:06.479179 run patchelf(pid=29289): Launched 11:01:06.658409 run osmo-stp_10.42.42.5(pid=29286): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29286)] 11:01:06.793510 run osmo-stp_10.42.42.5(pid=29286): stdout: | (launched: 2022-12-09_11:01:05.352332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:06.930336 run osmo-stp_10.42.42.5(pid=29286): stderr: | 20221209110105539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110105539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110105539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110105539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110105540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110105540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110105540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:07.066894 run osmo-stp_10.42.42.5(pid=29286): stdout: | (launched: 2022-12-09_11:01:05.352332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:07.197415 run osmo-stp_10.42.42.5(pid=29286): stderr: | 20221209110105539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110105539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110105539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110105539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110105540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110105540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110105540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:07.352093 run patchelf(pid=29289): Terminating (SIGINT) 11:01:07.531401 run patchelf(pid=29289): Terminated: ok {rc=0} 11:01:07.660741 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29286): Process ended prematurely: osmo-stp_10.42.42.5(pid=29286) [trial-2358↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29286)] [trial-2358↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 11:01:07.670391 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:01:07.699492 run osmo-hlr_10.42.42.2(pid=29283): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29283)] 11:01:07.749793 run osmo-hlr_10.42.42.2(pid=29283): stdout: | (launched: 2022-12-09_11:01:04.356419) 11:01:07.801822 run osmo-hlr_10.42.42.2(pid=29283): stderr: | 20221209110104550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110104550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110104550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110104550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110104551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110104551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110104562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110104571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110104572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110104572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:07.854244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29282): Terminating (SIGTERM) 11:01:07.896625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29285): Terminating (SIGTERM) 11:01:07.939204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29288): Terminating (SIGTERM) 11:01:07.981516 --- ParallelTerminationStrategy: PID 29282 died... 11:01:08.001862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29282): Terminated: ok {rc=0} 11:01:08.048383 --- ParallelTerminationStrategy: PID 29285 died... 11:01:08.068039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29285): Terminated: ok {rc=0} 11:01:08.114563 --- ParallelTerminationStrategy: PID 29288 died... 11:01:08.134129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29288): Terminated: ok {rc=0} 11:01:08.222193 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 11:01:09.523305 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:09.530350 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:01:09.563815 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:01:09.603271 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:01:09.691303 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:01:09.724167 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:01:09.763304 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:01:10.365407 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:01:10.418240 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:10.429546 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:01:10.478990 tst cs_paging_gprs_active.py: using LAC 21006 11:01:10.607387 tst cs_paging_gprs_active.py: using RAC 96 11:01:10.734117 tst cs_paging_gprs_active.py: using CellId 21006 11:01:10.859362 tst cs_paging_gprs_active.py: using BVCI 21007 11:01:10.978500 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:10.989910 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.001059 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.012359 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.023612 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.034987 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.046360 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.057622 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:11.068926 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:11.185077 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:11.305438 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:01:11.525005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:11.851020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29293): Launched 11:01:12.136193 run iperf3-srv_10.42.42.10(pid=29294): Launched 11:01:12.259182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:01:12.478577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:12.805478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29295): Launched 11:01:13.089610 run iperf3-srv_10.42.42.10(pid=29296): Launched 11:01:13.213965 tst cs_paging_gprs_active.py:38: start network... 11:01:13.433056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:13.940846 run create_hlr_db(pid=29297): Launched 11:01:14.066873 bus /gobi_6: Setting Powered False 11:01:15.130748 run create_hlr_db(pid=29297): Terminated: ok {rc=0} 11:01:15.592814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29299): Launched 11:01:15.927359 run osmo-hlr_10.42.42.2(pid=29300): Launched 11:01:16.128047 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:16.855162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29302): Launched 11:01:17.294307 run osmo-stp_10.42.42.5(pid=29303): Launched 11:01:17.521731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:18.050949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29305): Launched 11:01:18.169857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:18.426946 run patchelf(pid=29306): Launched 11:01:18.596562 run osmo-stp_10.42.42.5(pid=29303): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29303)] 11:01:18.725775 run osmo-stp_10.42.42.5(pid=29303): stdout: | (launched: 2022-12-09_11:01:17.214930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:18.855818 run osmo-stp_10.42.42.5(pid=29303): stderr: | 20221209110117458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110117458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110117459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110117459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110117459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110117460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110117460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:18.986313 run osmo-stp_10.42.42.5(pid=29303): stdout: | (launched: 2022-12-09_11:01:17.214930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:19.111326 run osmo-stp_10.42.42.5(pid=29303): stderr: | 20221209110117458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110117458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110117459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110117459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110117459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110117460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110117460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:19.259436 run patchelf(pid=29306): Terminating (SIGINT) 11:01:19.429473 run patchelf(pid=29306): Terminated: ok {rc=0} 11:01:19.552058 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29303): Process ended prematurely: osmo-stp_10.42.42.5(pid=29303) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29303)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:01:19.561866 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 11:01:19.589368 run osmo-hlr_10.42.42.2(pid=29300): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29300)] 11:01:19.637228 run osmo-hlr_10.42.42.2(pid=29300): stdout: | (launched: 2022-12-09_11:01:15.859265) 11:01:19.686472 run osmo-hlr_10.42.42.2(pid=29300): stderr: | 20221209110116169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110116169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110116170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110116170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110116170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110116170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110116187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110116217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110116217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110116217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:19.736410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29293): Terminating (SIGTERM) 11:01:19.776237 run iperf3-srv_10.42.42.10(pid=29294): Terminating (SIGTERM) 11:01:19.815922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29295): Terminating (SIGTERM) 11:01:19.855740 run iperf3-srv_10.42.42.10(pid=29296): Terminating (SIGTERM) 11:01:19.895269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29299): Terminating (SIGTERM) 11:01:19.934901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29302): Terminating (SIGTERM) 11:01:19.974514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29305): Terminating (SIGTERM) 11:01:20.015141 --- ParallelTerminationStrategy: PID 29293 died... 11:01:20.034482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29293): Terminated: ok {rc=0} 11:01:20.078695 --- ParallelTerminationStrategy: PID 29294 died... 11:01:20.097497 run iperf3-srv_10.42.42.10(pid=29294): Terminated {rc=256} 11:01:20.141393 --- ParallelTerminationStrategy: PID 29295 died... 11:01:20.160372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29295): Terminated: ok {rc=0} 11:01:20.204186 --- ParallelTerminationStrategy: PID 29296 died... 11:01:20.222987 run iperf3-srv_10.42.42.10(pid=29296): Terminated {rc=256} 11:01:20.267159 --- ParallelTerminationStrategy: PID 29299 died... 11:01:20.286072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29299): Terminated: ok {rc=0} 11:01:20.330131 --- ParallelTerminationStrategy: PID 29302 died... 11:01:20.348907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29302): Terminated: ok {rc=0} 11:01:20.392732 --- ParallelTerminationStrategy: PID 29305 died... 11:01:20.411318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29305): Terminated: ok {rc=0} 11:01:20.495694 bus /gobi_0: Setting Powered False 11:01:21.591893 bus /gobi_0: Setting Powered False 11:01:22.707478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:01:23.852856 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:23.864377 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:01:23.916159 tst iperf3.py: using LAC 21007 11:01:24.034908 tst iperf3.py: using RAC 97 11:01:24.155607 tst iperf3.py: using CellId 21007 11:01:24.273910 tst iperf3.py: using BVCI 21008 11:01:24.385708 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.396835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.407524 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.418300 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.428823 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.439443 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.450193 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.460637 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:24.471452 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:24.590249 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:01:24.794739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:25.100890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29307): Launched 11:01:25.365862 run iperf3-srv_10.42.42.10(pid=29308): Launched 11:01:25.480368 tst iperf3.py:8: start network... 11:01:25.684514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:26.159923 run create_hlr_db(pid=29309): Launched 11:01:26.284014 bus /gobi_6: Setting Powered False 11:01:27.343582 run create_hlr_db(pid=29309): Terminated: ok {rc=0} 11:01:27.765739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Launched 11:01:28.068343 run osmo-hlr_10.42.42.2(pid=29312): Launched 11:01:28.182952 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:28.704277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Launched 11:01:29.007415 run osmo-stp_10.42.42.5(pid=29315): Launched 11:01:29.122852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:29.645352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29317): Launched 11:01:29.760396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:30.015934 run patchelf(pid=29318): Launched 11:01:30.185285 run osmo-stp_10.42.42.5(pid=29315): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] 11:01:30.312714 run osmo-stp_10.42.42.5(pid=29315): stdout: | (launched: 2022-12-09_11:01:28.951222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:30.441977 run osmo-stp_10.42.42.5(pid=29315): stderr: | 20221209110129117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110129117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110129118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110129118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110129118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110129118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110129119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:30.571055 run osmo-stp_10.42.42.5(pid=29315): stdout: | (launched: 2022-12-09_11:01:28.951222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:30.694735 run osmo-stp_10.42.42.5(pid=29315): stderr: | 20221209110129117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110129117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110129118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110129118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110129118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110129118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110129119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:30.852297 run patchelf(pid=29318): Terminating (SIGINT) 11:01:31.050052 run patchelf(pid=29318): Terminated: ok {rc=0} 11:01:31.187596 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29315): Process ended prematurely: osmo-stp_10.42.42.5(pid=29315) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 11:01:31.199339 tst iperf3.py:8: Test FAILED (7.4 sec) 11:01:31.232316 run osmo-hlr_10.42.42.2(pid=29312): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29312)] 11:01:31.286455 run osmo-hlr_10.42.42.2(pid=29312): stdout: | (launched: 2022-12-09_11:01:28.011702) 11:01:31.346091 run osmo-hlr_10.42.42.2(pid=29312): stderr: | 20221209110128186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110128186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110128186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110128186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110128186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110128186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110128198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110128207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110128207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110128207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:31.402750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29307): Terminating (SIGTERM) 11:01:31.448162 run iperf3-srv_10.42.42.10(pid=29308): Terminating (SIGTERM) 11:01:31.495790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Terminating (SIGTERM) 11:01:31.543108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Terminating (SIGTERM) 11:01:31.590728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29317): Terminating (SIGTERM) 11:01:31.638731 --- ParallelTerminationStrategy: PID 29307 died... 11:01:31.660445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29307): Terminated: ok {rc=0} 11:01:31.712618 --- ParallelTerminationStrategy: PID 29308 died... 11:01:31.733642 run iperf3-srv_10.42.42.10(pid=29308): Terminated {rc=256} 11:01:31.784674 --- ParallelTerminationStrategy: PID 29311 died... 11:01:31.805709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Terminated: ok {rc=0} 11:01:31.856659 --- ParallelTerminationStrategy: PID 29314 died... 11:01:31.877538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Terminated: ok {rc=0} 11:01:31.929289 --- ParallelTerminationStrategy: PID 29317 died... 11:01:31.951416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29317): Terminated: ok {rc=0} 11:01:32.043972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:01:33.189539 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.204146 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:01:33.251529 tst iperf3m4.py: using LAC 21008 11:01:33.374803 tst iperf3m4.py: using RAC 98 11:01:33.493611 tst iperf3m4.py: using CellId 21008 11:01:33.611009 tst iperf3m4.py: using BVCI 21009 11:01:33.721691 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.732473 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.743343 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.754091 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.764640 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.775277 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.786116 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.796672 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:33.807501 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:33.927030 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:34.047763 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:34.165627 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:34.283059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:01:34.485400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:34.789472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29319): Launched 11:01:35.054874 run iperf3-srv_10.42.42.10(pid=29320): Launched 11:01:35.169260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:01:35.370830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:35.674493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29321): Launched 11:01:35.940524 run iperf3-srv_10.42.42.10(pid=29322): Launched 11:01:36.054210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:01:36.256173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:36.560190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29323): Launched 11:01:36.824182 run iperf3-srv_10.42.42.10(pid=29324): Launched 11:01:36.937902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:01:37.139270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:37.443069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29325): Launched 11:01:37.707704 run iperf3-srv_10.42.42.10(pid=29326): Launched 11:01:37.821481 tst iperf3m4.py:8: start network... 11:01:38.022734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:38.494112 run create_hlr_db(pid=29327): Launched 11:01:38.626689 bus /gobi_6: Setting Powered False 11:01:39.690770 run create_hlr_db(pid=29327): Terminated: ok {rc=0} 11:01:40.123806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29329): Launched 11:01:40.428594 run osmo-hlr_10.42.42.2(pid=29330): Launched 11:01:40.543620 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:41.085160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29332): Launched 11:01:41.388007 run osmo-stp_10.42.42.5(pid=29333): Launched 11:01:41.503489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:42.026447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29335): Launched 11:01:42.143444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:42.399495 run patchelf(pid=29336): Launched 11:01:42.567589 run osmo-stp_10.42.42.5(pid=29333): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29333)] 11:01:42.694628 run osmo-stp_10.42.42.5(pid=29333): stdout: | (launched: 2022-12-09_11:01:41.331708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:42.823081 run osmo-stp_10.42.42.5(pid=29333): stderr: | 20221209110141498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110141499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110141499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110141499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110141500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110141500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110141500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:42.951398 run osmo-stp_10.42.42.5(pid=29333): stdout: | (launched: 2022-12-09_11:01:41.331708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:43.074769 run osmo-stp_10.42.42.5(pid=29333): stderr: | 20221209110141498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110141499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110141499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110141499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110141500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110141500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110141500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:43.220832 run patchelf(pid=29336): Terminating (SIGINT) 11:01:43.390000 run patchelf(pid=29336): Terminated: ok {rc=0} 11:01:43.511445 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29333): Process ended prematurely: osmo-stp_10.42.42.5(pid=29333) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29333)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 11:01:43.521074 tst iperf3m4.py:8: Test FAILED (10.4 sec) 11:01:43.548710 run osmo-hlr_10.42.42.2(pid=29330): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29330)] 11:01:43.596299 run osmo-hlr_10.42.42.2(pid=29330): stdout: | (launched: 2022-12-09_11:01:40.372418) 11:01:43.645161 run osmo-hlr_10.42.42.2(pid=29330): stderr: | 20221209110140547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110140547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110140547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110140547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110140547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110140547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110140559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110140568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110140568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110140568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:43.694076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29319): Terminating (SIGTERM) 11:01:43.733280 run iperf3-srv_10.42.42.10(pid=29320): Terminating (SIGTERM) 11:01:43.772699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29321): Terminating (SIGTERM) 11:01:43.811959 run iperf3-srv_10.42.42.10(pid=29322): Terminating (SIGTERM) 11:01:43.851126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29323): Terminating (SIGTERM) 11:01:43.890405 run iperf3-srv_10.42.42.10(pid=29324): Terminating (SIGTERM) 11:01:43.929541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29325): Terminating (SIGTERM) 11:01:43.968666 run iperf3-srv_10.42.42.10(pid=29326): Terminating (SIGTERM) 11:01:44.007684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29329): Terminating (SIGTERM) 11:01:44.046982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29332): Terminating (SIGTERM) 11:01:44.086393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29335): Terminating (SIGTERM) 11:01:44.126114 --- ParallelTerminationStrategy: PID 29319 died... 11:01:44.145294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29319): Terminated: ok {rc=0} 11:01:44.189512 --- ParallelTerminationStrategy: PID 29320 died... 11:01:44.207964 run iperf3-srv_10.42.42.10(pid=29320): Terminated {rc=256} 11:01:44.251503 --- ParallelTerminationStrategy: PID 29321 died... 11:01:44.270082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29321): Terminated: ok {rc=0} 11:01:44.313507 --- ParallelTerminationStrategy: PID 29322 died... 11:01:44.331916 run iperf3-srv_10.42.42.10(pid=29322): Terminated {rc=256} 11:01:44.375383 --- ParallelTerminationStrategy: PID 29323 died... 11:01:44.393936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29323): Terminated: ok {rc=0} 11:01:44.437352 --- ParallelTerminationStrategy: PID 29324 died... 11:01:44.455727 run iperf3-srv_10.42.42.10(pid=29324): Terminated {rc=256} 11:01:44.499297 --- ParallelTerminationStrategy: PID 29325 died... 11:01:44.517882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29325): Terminated: ok {rc=0} 11:01:44.561379 --- ParallelTerminationStrategy: PID 29326 died... 11:01:44.580075 run iperf3-srv_10.42.42.10(pid=29326): Terminated {rc=256} 11:01:44.623403 --- ParallelTerminationStrategy: PID 29329 died... 11:01:44.641947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29329): Terminated: ok {rc=0} 11:01:44.685997 --- ParallelTerminationStrategy: PID 29332 died... 11:01:44.704587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29332): Terminated: ok {rc=0} 11:01:44.748085 --- ParallelTerminationStrategy: PID 29335 died... 11:01:44.766724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29335): Terminated: ok {rc=0} 11:01:44.852013 bus /gobi_4: Setting Powered False 11:01:45.956585 bus /gobi_4: Setting Powered False 11:01:47.086194 bus /gobi_1: Setting Powered False 11:01:48.199310 bus /gobi_1: Setting Powered False 11:01:49.316502 bus /gobi_0: Setting Powered False 11:01:50.414322 bus /gobi_0: Setting Powered False 11:01:51.529917 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 11:01:52.632577 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:52.644740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:01:52.696346 tst ping.py: using LAC 21009 11:01:52.823843 tst ping.py: using RAC 99 11:01:52.950820 tst ping.py: using CellId 21009 11:01:53.077605 tst ping.py: using BVCI 21010 11:01:53.185938 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.196812 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.207749 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.218563 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.229280 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.239908 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.250789 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:01:53.261640 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:01:53.378731 tst ping.py:19: start network... 11:01:53.592770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:54.087599 run create_hlr_db(pid=29337): Launched 11:01:54.210191 bus /gobi_6: Setting Powered False 11:01:55.273556 run create_hlr_db(pid=29337): Terminated: ok {rc=0} 11:01:55.700659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29339): Launched 11:01:55.998578 run osmo-hlr_10.42.42.2(pid=29340): Launched 11:01:56.111977 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:56.642076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29342): Launched 11:01:56.937968 run osmo-stp_10.42.42.5(pid=29343): Launched 11:01:57.051865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:57.563309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29345): Launched 11:01:57.676481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:57.927246 run patchelf(pid=29346): Launched 11:01:58.094823 run osmo-stp_10.42.42.5(pid=29343): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29343)] 11:01:58.220559 run osmo-stp_10.42.42.5(pid=29343): stdout: | (launched: 2022-12-09_11:01:56.882438) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:58.348382 run osmo-stp_10.42.42.5(pid=29343): stderr: | 20221209110157047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110157047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110157047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110157048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110157048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110157048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110157048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:58.475396 run osmo-stp_10.42.42.5(pid=29343): stdout: | (launched: 2022-12-09_11:01:56.882438) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:58.597233 run osmo-stp_10.42.42.5(pid=29343): stderr: | 20221209110157047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110157047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110157047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110157048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110157048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110157048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110157048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:58.741100 run patchelf(pid=29346): Terminating (SIGINT) 11:01:58.907410 run patchelf(pid=29346): Terminated: ok {rc=0} 11:01:59.027266 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29343): Process ended prematurely: osmo-stp_10.42.42.5(pid=29343) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29343)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 11:01:59.036281 tst ping.py:22: Test FAILED (6.4 sec) 11:01:59.063249 run osmo-hlr_10.42.42.2(pid=29340): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29340)] 11:01:59.110407 run osmo-hlr_10.42.42.2(pid=29340): stdout: | (launched: 2022-12-09_11:01:55.943274) 11:01:59.159349 run osmo-hlr_10.42.42.2(pid=29340): stderr: | 20221209110156115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110156115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110156115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110156115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110156115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110156115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110156127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110156138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110156138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110156139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:59.209248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29339): Terminating (SIGTERM) 11:01:59.248857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29342): Terminating (SIGTERM) 11:01:59.288758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29345): Terminating (SIGTERM) 11:01:59.328643 --- ParallelTerminationStrategy: PID 29339 died... 11:01:59.348009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29339): Terminated: ok {rc=0} 11:01:59.391966 --- ParallelTerminationStrategy: PID 29342 died... 11:01:59.410693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29342): Terminated: ok {rc=0} 11:01:59.454366 --- ParallelTerminationStrategy: PID 29345 died... 11:01:59.473098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29345): Terminated: ok {rc=0} 11:01:59.557394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:02:00.643662 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:00.656292 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:02:00.710479 tst ping_idle_ping.py: using LAC 21010 11:02:00.843250 tst ping_idle_ping.py: using RAC 100 11:02:00.974937 tst ping_idle_ping.py: using CellId 21010 11:02:01.113818 tst ping_idle_ping.py: using BVCI 21011 11:02:01.235121 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.247361 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.259264 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.271877 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.284566 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.297175 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.310788 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:01.322803 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:02:01.445068 tst ping_idle_ping.py:24: start network... 11:02:01.736614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:02.245512 run create_hlr_db(pid=29347): Launched 11:02:02.375857 bus /gobi_6: Setting Powered False 11:02:03.436257 run create_hlr_db(pid=29347): Terminated: ok {rc=0} 11:02:03.854022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29349): Launched 11:02:04.152628 run osmo-hlr_10.42.42.2(pid=29350): Launched 11:02:04.265126 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:04.795425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29352): Launched 11:02:05.094037 run osmo-stp_10.42.42.5(pid=29353): Launched 11:02:05.207471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:05.720681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29355): Launched 11:02:05.834952 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:06.086548 run patchelf(pid=29356): Launched 11:02:06.253257 run osmo-stp_10.42.42.5(pid=29353): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29353)] 11:02:06.380198 run osmo-stp_10.42.42.5(pid=29353): stdout: | (launched: 2022-12-09_11:02:05.038347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:06.507440 run osmo-stp_10.42.42.5(pid=29353): stderr: | 20221209110205204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110205204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110205205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110205205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110205206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110205206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110205206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:06.634716 run osmo-stp_10.42.42.5(pid=29353): stdout: | (launched: 2022-12-09_11:02:05.038347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:06.756029 run osmo-stp_10.42.42.5(pid=29353): stderr: | 20221209110205204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110205204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110205205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110205205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110205206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110205206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110205206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:06.900440 run patchelf(pid=29356): Terminating (SIGINT) 11:02:07.067427 run patchelf(pid=29356): Terminated: ok {rc=0} 11:02:07.189492 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29353): Process ended prematurely: osmo-stp_10.42.42.5(pid=29353) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29353)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 11:02:07.198420 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:02:07.225298 run osmo-hlr_10.42.42.2(pid=29350): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29350)] 11:02:07.272577 run osmo-hlr_10.42.42.2(pid=29350): stdout: | (launched: 2022-12-09_11:02:04.096826) 11:02:07.321789 run osmo-hlr_10.42.42.2(pid=29350): stderr: | 20221209110204269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110204269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110204269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110204269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110204269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110204269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110204281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110204291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110204291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110204291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:07.371170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29349): Terminating (SIGTERM) 11:02:07.410631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29352): Terminating (SIGTERM) 11:02:07.450217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29355): Terminating (SIGTERM) 11:02:07.489914 --- ParallelTerminationStrategy: PID 29349 died... 11:02:07.509055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29349): Terminated: ok {rc=0} 11:02:07.553099 --- ParallelTerminationStrategy: PID 29352 died... 11:02:07.571768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29352): Terminated: ok {rc=0} 11:02:07.615711 --- ParallelTerminationStrategy: PID 29355 died... 11:02:07.634329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29355): Terminated: ok {rc=0} 11:02:07.719553 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:02:09.019269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:02:09.026053 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:02:09.057570 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:02:09.095561 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:02:09.182020 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:02:09.213608 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:02:09.251181 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:02:09.845145 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:02:09.893990 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:09.904775 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:02:09.970741 tst cs_paging_gprs_active.py: using LAC 21011 11:02:10.090567 tst cs_paging_gprs_active.py: using RAC 101 11:02:10.211592 tst cs_paging_gprs_active.py: using CellId 21011 11:02:10.332509 tst cs_paging_gprs_active.py: using BVCI 21012 11:02:10.444679 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.455594 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.466305 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.477015 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.487660 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.498365 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.509073 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.519627 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:10.530504 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:10.649115 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:10.765829 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:02:10.969070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:11.273125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29361): Launched 11:02:11.538366 run iperf3-srv_10.42.42.10(pid=29362): Launched 11:02:11.652027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:02:11.854618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:12.159587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29363): Launched 11:02:12.425724 run iperf3-srv_10.42.42.10(pid=29364): Launched 11:02:12.542054 tst cs_paging_gprs_active.py:38: start network... 11:02:12.744641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:13.216122 run create_hlr_db(pid=29365): Launched 11:02:13.340689 bus /gobi_6: Setting Powered False 11:02:14.405506 run create_hlr_db(pid=29365): Terminated: ok {rc=0} 11:02:14.841413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Launched 11:02:15.147362 run osmo-hlr_10.42.42.2(pid=29368): Launched 11:02:15.264053 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:15.801348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Launched 11:02:16.121522 run osmo-stp_10.42.42.5(pid=29371): Launched 11:02:16.356796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:17.060118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29373): Launched 11:02:17.191918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:17.452466 run patchelf(pid=29374): Launched 11:02:17.622368 run osmo-stp_10.42.42.5(pid=29371): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] 11:02:17.751442 run osmo-stp_10.42.42.5(pid=29371): stdout: | (launched: 2022-12-09_11:02:16.063910) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:17.881387 run osmo-stp_10.42.42.5(pid=29371): stderr: | 20221209110216388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110216388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110216388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110216389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110216389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110216389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110216389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:18.011496 run osmo-stp_10.42.42.5(pid=29371): stdout: | (launched: 2022-12-09_11:02:16.063910) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:18.135927 run osmo-stp_10.42.42.5(pid=29371): stderr: | 20221209110216388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110216388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110216388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110216389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110216389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110216389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110216389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:18.283335 run patchelf(pid=29374): Terminating (SIGINT) 11:02:18.454208 run patchelf(pid=29374): Terminated: ok {rc=0} 11:02:18.577342 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29371): Process ended prematurely: osmo-stp_10.42.42.5(pid=29371) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:02:18.586933 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:02:18.614519 run osmo-hlr_10.42.42.2(pid=29368): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29368)] 11:02:18.662302 run osmo-hlr_10.42.42.2(pid=29368): stdout: | (launched: 2022-12-09_11:02:15.090541) 11:02:18.711923 run osmo-hlr_10.42.42.2(pid=29368): stderr: | 20221209110215263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110215263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110215263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110215263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110215263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110215263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110215275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110215283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110215284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110215284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:18.761935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29361): Terminating (SIGTERM) 11:02:18.801852 run iperf3-srv_10.42.42.10(pid=29362): Terminating (SIGTERM) 11:02:18.841783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29363): Terminating (SIGTERM) 11:02:18.881626 run iperf3-srv_10.42.42.10(pid=29364): Terminating (SIGTERM) 11:02:18.921294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Terminating (SIGTERM) 11:02:18.961235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Terminating (SIGTERM) 11:02:19.001257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29373): Terminating (SIGTERM) 11:02:19.041916 --- ParallelTerminationStrategy: PID 29361 died... 11:02:19.061300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29361): Terminated: ok {rc=0} 11:02:19.105380 --- ParallelTerminationStrategy: PID 29362 died... 11:02:19.124104 run iperf3-srv_10.42.42.10(pid=29362): Terminated {rc=256} 11:02:19.167935 --- ParallelTerminationStrategy: PID 29363 died... 11:02:19.186731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29363): Terminated: ok {rc=0} 11:02:19.230635 --- ParallelTerminationStrategy: PID 29364 died... 11:02:19.249379 run iperf3-srv_10.42.42.10(pid=29364): Terminated {rc=256} 11:02:19.293392 --- ParallelTerminationStrategy: PID 29367 died... 11:02:19.312162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Terminated: ok {rc=0} 11:02:19.356362 --- ParallelTerminationStrategy: PID 29370 died... 11:02:19.375222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Terminated: ok {rc=0} 11:02:19.419123 --- ParallelTerminationStrategy: PID 29373 died... 11:02:19.437918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29373): Terminated: ok {rc=0} 11:02:19.523938 bus /gobi_0: Setting Powered False 11:02:20.625037 bus /gobi_0: Setting Powered False 11:02:21.741015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:02:22.892816 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:22.905163 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:02:22.977412 tst iperf3.py: using LAC 21012 11:02:23.107076 tst iperf3.py: using RAC 102 11:02:23.234578 tst iperf3.py: using CellId 21012 11:02:23.362282 tst iperf3.py: using BVCI 21013 11:02:23.482775 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.494368 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.505811 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.517544 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.529288 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.540937 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.552614 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.564192 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:23.575819 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:23.691550 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:02:23.892843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:24.196915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29375): Launched 11:02:24.462224 run iperf3-srv_10.42.42.10(pid=29376): Launched 11:02:24.576466 tst iperf3.py:8: start network... 11:02:24.777798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:25.248008 run create_hlr_db(pid=29377): Launched 11:02:25.372883 bus /gobi_6: Setting Powered False 11:02:26.433398 run create_hlr_db(pid=29377): Terminated: ok {rc=0} 11:02:26.877378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29379): Launched 11:02:27.205220 run osmo-hlr_10.42.42.2(pid=29380): Launched 11:02:27.331282 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:27.891012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29382): Launched 11:02:28.218578 run osmo-stp_10.42.42.5(pid=29383): Launched 11:02:28.343334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:28.905502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29385): Launched 11:02:29.031643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:29.307794 run patchelf(pid=29386): Launched 11:02:29.490644 run osmo-stp_10.42.42.5(pid=29383): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29383)] 11:02:29.627958 run osmo-stp_10.42.42.5(pid=29383): stdout: | (launched: 2022-12-09_11:02:28.158940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:29.767450 run osmo-stp_10.42.42.5(pid=29383): stderr: | 20221209110228347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110228347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110228347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110228348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110228348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110228348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110228348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:29.906438 run osmo-stp_10.42.42.5(pid=29383): stdout: | (launched: 2022-12-09_11:02:28.158940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:30.040362 run osmo-stp_10.42.42.5(pid=29383): stderr: | 20221209110228347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110228347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110228347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110228348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110228348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110228348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110228348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:30.198461 run patchelf(pid=29386): Terminating (SIGINT) 11:02:30.381240 run patchelf(pid=29386): Terminated: ok {rc=0} 11:02:30.512849 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29383): Process ended prematurely: osmo-stp_10.42.42.5(pid=29383) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29383)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 11:02:30.523217 tst iperf3.py:8: Test FAILED (7.7 sec) 11:02:30.552723 run osmo-hlr_10.42.42.2(pid=29380): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29380)] 11:02:30.603611 run osmo-hlr_10.42.42.2(pid=29380): stdout: | (launched: 2022-12-09_11:02:27.145593) 11:02:30.655991 run osmo-hlr_10.42.42.2(pid=29380): stderr: | 20221209110227340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110227340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110227340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110227340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110227340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110227340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110227352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110227362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110227362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110227362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:30.709250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29375): Terminating (SIGTERM) 11:02:30.751478 run iperf3-srv_10.42.42.10(pid=29376): Terminating (SIGTERM) 11:02:30.793753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29379): Terminating (SIGTERM) 11:02:30.839146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29382): Terminating (SIGTERM) 11:02:30.904209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29385): Terminating (SIGTERM) 11:02:30.949341 --- ParallelTerminationStrategy: PID 29375 died... 11:02:30.968752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29375): Terminated: ok {rc=0} 11:02:31.014967 --- ParallelTerminationStrategy: PID 29376 died... 11:02:31.034673 run iperf3-srv_10.42.42.10(pid=29376): Terminated {rc=256} 11:02:31.079459 --- ParallelTerminationStrategy: PID 29379 died... 11:02:31.098581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29379): Terminated: ok {rc=0} 11:02:31.144450 --- ParallelTerminationStrategy: PID 29382 died... 11:02:31.164276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29382): Terminated: ok {rc=0} 11:02:31.210874 --- ParallelTerminationStrategy: PID 29385 died... 11:02:31.230670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29385): Terminated: ok {rc=0} 11:02:31.317242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:02:32.464666 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:32.476220 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:02:32.542478 tst iperf3m4.py: using LAC 21013 11:02:32.661989 tst iperf3m4.py: using RAC 103 11:02:32.789991 tst iperf3m4.py: using CellId 21013 11:02:32.918044 tst iperf3m4.py: using BVCI 21014 11:02:33.037794 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.049337 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.060626 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.072300 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.083559 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.094788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.106477 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.119225 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:33.131009 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:33.247003 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:33.368791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:33.486370 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:33.603008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:02:33.805553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:34.110467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29387): Launched 11:02:34.377472 run iperf3-srv_10.42.42.10(pid=29388): Launched 11:02:34.491721 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:02:34.695514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:35.000582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29389): Launched 11:02:35.263989 run iperf3-srv_10.42.42.10(pid=29390): Launched 11:02:35.377428 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:02:35.578395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:35.884785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29392): Launched 11:02:36.148555 run iperf3-srv_10.42.42.10(pid=29393): Launched 11:02:36.262305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:02:36.463075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:36.767250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29394): Launched 11:02:37.031450 run iperf3-srv_10.42.42.10(pid=29395): Launched 11:02:37.144914 tst iperf3m4.py:8: start network... 11:02:37.346117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:37.814429 run create_hlr_db(pid=29396): Launched 11:02:37.941320 bus /gobi_6: Setting Powered False 11:02:39.002002 run create_hlr_db(pid=29396): Terminated: ok {rc=0} 11:02:39.446037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29398): Launched 11:02:39.773548 run osmo-hlr_10.42.42.2(pid=29399): Launched 11:02:39.899463 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:40.463724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29401): Launched 11:02:40.792152 run osmo-stp_10.42.42.5(pid=29402): Launched 11:02:40.918041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:41.479790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29404): Launched 11:02:41.605673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:41.879685 run patchelf(pid=29405): Launched 11:02:42.063346 run osmo-stp_10.42.42.5(pid=29402): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29402)] 11:02:42.200066 run osmo-stp_10.42.42.5(pid=29402): stdout: | (launched: 2022-12-09_11:02:40.732122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:42.338912 run osmo-stp_10.42.42.5(pid=29402): stderr: | 20221209110240919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110240919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110240919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110240920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110240920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110240920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110240920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:42.477274 run osmo-stp_10.42.42.5(pid=29402): stdout: | (launched: 2022-12-09_11:02:40.732122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:42.610377 run osmo-stp_10.42.42.5(pid=29402): stderr: | 20221209110240919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110240919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110240919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110240920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110240920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110240920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110240920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:42.767839 run patchelf(pid=29405): Terminating (SIGINT) 11:02:42.950011 run patchelf(pid=29405): Terminated: ok {rc=0} 11:02:43.081719 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29402): Process ended prematurely: osmo-stp_10.42.42.5(pid=29402) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29402)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:02:43.092083 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:02:43.121869 run osmo-hlr_10.42.42.2(pid=29399): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29399)] 11:02:43.172403 run osmo-hlr_10.42.42.2(pid=29399): stdout: | (launched: 2022-12-09_11:02:39.713695) 11:02:43.224733 run osmo-hlr_10.42.42.2(pid=29399): stderr: | 20221209110239906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110239906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110239906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110239906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110239906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110239906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110239919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110239930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110239930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110239930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:43.277676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29387): Terminating (SIGTERM) 11:02:43.319859 run iperf3-srv_10.42.42.10(pid=29388): Terminating (SIGTERM) 11:02:43.362059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29389): Terminating (SIGTERM) 11:02:43.404211 run iperf3-srv_10.42.42.10(pid=29390): Terminating (SIGTERM) 11:02:43.446347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29392): Terminating (SIGTERM) 11:02:43.488423 run iperf3-srv_10.42.42.10(pid=29393): Terminating (SIGTERM) 11:02:43.530596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29394): Terminating (SIGTERM) 11:02:43.572754 run iperf3-srv_10.42.42.10(pid=29395): Terminating (SIGTERM) 11:02:43.614643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29398): Terminating (SIGTERM) 11:02:43.656821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29401): Terminating (SIGTERM) 11:02:43.698959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29404): Terminating (SIGTERM) 11:02:43.741585 --- ParallelTerminationStrategy: PID 29387 died... 11:02:43.761397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29387): Terminated: ok {rc=0} 11:02:43.808348 --- ParallelTerminationStrategy: PID 29388 died... 11:02:43.827837 run iperf3-srv_10.42.42.10(pid=29388): Terminated {rc=256} 11:02:43.874741 --- ParallelTerminationStrategy: PID 29389 died... 11:02:43.894423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29389): Terminated: ok {rc=0} 11:02:43.941575 --- ParallelTerminationStrategy: PID 29390 died... 11:02:43.961705 run iperf3-srv_10.42.42.10(pid=29390): Terminated {rc=256} 11:02:44.008404 --- ParallelTerminationStrategy: PID 29392 died... 11:02:44.027809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29392): Terminated: ok {rc=0} 11:02:44.075136 --- ParallelTerminationStrategy: PID 29393 died... 11:02:44.094933 run iperf3-srv_10.42.42.10(pid=29393): Terminated {rc=256} 11:02:44.141631 --- ParallelTerminationStrategy: PID 29394 died... 11:02:44.161334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29394): Terminated: ok {rc=0} 11:02:44.208365 --- ParallelTerminationStrategy: PID 29395 died... 11:02:44.228063 run iperf3-srv_10.42.42.10(pid=29395): Terminated {rc=256} 11:02:44.274744 --- ParallelTerminationStrategy: PID 29398 died... 11:02:44.294399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29398): Terminated: ok {rc=0} 11:02:44.341235 --- ParallelTerminationStrategy: PID 29401 died... 11:02:44.361276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29401): Terminated: ok {rc=0} 11:02:44.407990 --- ParallelTerminationStrategy: PID 29404 died... 11:02:44.427780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29404): Terminated: ok {rc=0} 11:02:44.516107 bus /gobi_4: Setting Powered False 11:02:45.616511 bus /gobi_4: Setting Powered False 11:02:46.742160 bus /gobi_1: Setting Powered False 11:02:47.855799 bus /gobi_1: Setting Powered False 11:02:48.972628 bus /gobi_0: Setting Powered False 11:02:50.070733 bus /gobi_0: Setting Powered False 11:02:51.189965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:02:52.293952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.305401 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:02:52.371951 tst ping.py: using LAC 21014 11:02:52.491000 tst ping.py: using RAC 104 11:02:52.609369 tst ping.py: using CellId 21014 11:02:52.726233 tst ping.py: using BVCI 21015 11:02:52.834587 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.845619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.856306 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.867055 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.877747 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.888606 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.899419 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:02:52.910122 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:02:53.027796 tst ping.py:19: start network... 11:02:53.242972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:53.738292 run create_hlr_db(pid=29406): Launched 11:02:53.863414 bus /gobi_6: Setting Powered False 11:02:54.926689 run create_hlr_db(pid=29406): Terminated: ok {rc=0} 11:02:55.373835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29408): Launched 11:02:55.696517 run osmo-hlr_10.42.42.2(pid=29409): Launched 11:02:55.820884 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:56.375255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29411): Launched 11:02:56.697019 run osmo-stp_10.42.42.5(pid=29412): Launched 11:02:56.818806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:57.372126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29414): Launched 11:02:57.497122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:57.768135 run patchelf(pid=29415): Launched 11:02:57.947002 run osmo-stp_10.42.42.5(pid=29412): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29412)] 11:02:58.083141 run osmo-stp_10.42.42.5(pid=29412): stdout: | (launched: 2022-12-09_11:02:56.637525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:58.220071 run osmo-stp_10.42.42.5(pid=29412): stderr: | 20221209110256827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110256827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110256828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110256828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110256828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110256829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110256829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:58.356806 run osmo-stp_10.42.42.5(pid=29412): stdout: | (launched: 2022-12-09_11:02:56.637525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:58.487816 run osmo-stp_10.42.42.5(pid=29412): stderr: | 20221209110256827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110256827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110256828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110256828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110256828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110256829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110256829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:58.643446 run patchelf(pid=29415): Terminating (SIGINT) 11:02:58.822983 run patchelf(pid=29415): Terminated: ok {rc=0} 11:02:58.952125 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29412): Process ended prematurely: osmo-stp_10.42.42.5(pid=29412) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29412)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 11:02:58.962254 tst ping.py:22: Test FAILED (6.7 sec) 11:02:58.991602 run osmo-hlr_10.42.42.2(pid=29409): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29409)] 11:02:59.042137 run osmo-hlr_10.42.42.2(pid=29409): stdout: | (launched: 2022-12-09_11:02:55.637299) 11:02:59.094108 run osmo-hlr_10.42.42.2(pid=29409): stderr: | 20221209110255832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110255832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110255832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110255832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110255832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110255832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110255844 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110255853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110255853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110255853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:59.146448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29408): Terminating (SIGTERM) 11:02:59.187999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29411): Terminating (SIGTERM) 11:02:59.230049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29414): Terminating (SIGTERM) 11:02:59.272577 --- ParallelTerminationStrategy: PID 29408 died... 11:02:59.292759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29408): Terminated: ok {rc=0} 11:02:59.339854 --- ParallelTerminationStrategy: PID 29411 died... 11:02:59.359780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29411): Terminated: ok {rc=0} 11:02:59.406884 --- ParallelTerminationStrategy: PID 29414 died... 11:02:59.426694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29414): Terminated: ok {rc=0} 11:02:59.515701 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:03:00.603617 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:00.615769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:03:00.686643 tst ping_idle_ping.py: using LAC 21015 11:03:00.809302 tst ping_idle_ping.py: using RAC 105 11:03:00.948723 tst ping_idle_ping.py: using CellId 21015 11:03:01.071923 tst ping_idle_ping.py: using BVCI 21016 11:03:01.196097 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.208006 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.219744 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.232388 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.244020 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.256210 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.268618 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:01.280792 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:03:01.403604 tst ping_idle_ping.py:24: start network... 11:03:01.670160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:02.211729 run create_hlr_db(pid=29417): Launched 11:03:02.367936 bus /gobi_6: Setting Powered False 11:03:03.432271 run create_hlr_db(pid=29417): Terminated: ok {rc=0} 11:03:03.881076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29419): Launched 11:03:04.202421 run osmo-hlr_10.42.42.2(pid=29420): Launched 11:03:04.326239 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:04.879561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29422): Launched 11:03:05.202506 run osmo-stp_10.42.42.5(pid=29423): Launched 11:03:05.326237 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:05.879681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29425): Launched 11:03:06.004839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:06.277050 run patchelf(pid=29426): Launched 11:03:06.458179 run osmo-stp_10.42.42.5(pid=29423): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29423)] 11:03:06.594538 run osmo-stp_10.42.42.5(pid=29423): stdout: | (launched: 2022-12-09_11:03:05.143373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:06.732072 run osmo-stp_10.42.42.5(pid=29423): stderr: | 20221209110305330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110305331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110305331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110305332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110305332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110305332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110305332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:06.870174 run osmo-stp_10.42.42.5(pid=29423): stdout: | (launched: 2022-12-09_11:03:05.143373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:07.002330 run osmo-stp_10.42.42.5(pid=29423): stderr: | 20221209110305330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110305331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110305331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110305332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110305332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110305332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110305332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:07.158522 run patchelf(pid=29426): Terminating (SIGINT) 11:03:07.338186 run patchelf(pid=29426): Terminated: ok {rc=0} 11:03:07.467833 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29423): Process ended prematurely: osmo-stp_10.42.42.5(pid=29423) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29423)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:03:07.477607 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:03:07.506529 run osmo-hlr_10.42.42.2(pid=29420): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29420)] 11:03:07.557586 run osmo-hlr_10.42.42.2(pid=29420): stdout: | (launched: 2022-12-09_11:03:04.143345) 11:03:07.610062 run osmo-hlr_10.42.42.2(pid=29420): stderr: | 20221209110304337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110304338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110304339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110304339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110304339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110304339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110304352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110304360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110304360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110304360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:07.662837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29419): Terminating (SIGTERM) 11:03:07.705049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29422): Terminating (SIGTERM) 11:03:07.747497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29425): Terminating (SIGTERM) 11:03:07.790190 --- ParallelTerminationStrategy: PID 29419 died... 11:03:07.810345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29419): Terminated: ok {rc=0} 11:03:07.857512 --- ParallelTerminationStrategy: PID 29422 died... 11:03:07.877432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29422): Terminated: ok {rc=0} 11:03:07.924586 --- ParallelTerminationStrategy: PID 29425 died... 11:03:07.944454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29425): Terminated: ok {rc=0} 11:03:08.033749 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:03:09.350487 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:03:09.358899 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:03:09.393086 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:03:09.432249 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:03:09.521324 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:03:09.554875 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:03:09.593846 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:03:10.193377 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:03:10.245449 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.257327 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:03:10.308004 tst cs_paging_gprs_active.py: using LAC 21016 11:03:10.435134 tst cs_paging_gprs_active.py: using RAC 106 11:03:10.561097 tst cs_paging_gprs_active.py: using CellId 21016 11:03:10.686673 tst cs_paging_gprs_active.py: using BVCI 21017 11:03:10.805685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.817414 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.829055 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.840838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.852785 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.864745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.877701 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.889340 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:10.901573 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:11.023403 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:11.139405 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:03:11.340532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:11.641854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29430): Launched 11:03:11.905366 run iperf3-srv_10.42.42.10(pid=29431): Launched 11:03:12.018552 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:03:12.218926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:12.519893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29432): Launched 11:03:12.781051 run iperf3-srv_10.42.42.10(pid=29433): Launched 11:03:12.894648 tst cs_paging_gprs_active.py:38: start network... 11:03:13.094868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:13.561925 run create_hlr_db(pid=29434): Launched 11:03:13.688046 bus /gobi_6: Setting Powered False 11:03:14.751390 run create_hlr_db(pid=29434): Terminated: ok {rc=0} 11:03:15.182561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29436): Launched 11:03:15.482544 run osmo-hlr_10.42.42.2(pid=29437): Launched 11:03:15.597566 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:16.169883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29439): Launched 11:03:16.480651 run osmo-stp_10.42.42.5(pid=29440): Launched 11:03:16.755114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:17.332834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29442): Launched 11:03:17.449845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:17.705985 run patchelf(pid=29443): Launched 11:03:17.873934 run osmo-stp_10.42.42.5(pid=29440): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29440)] 11:03:18.001699 run osmo-stp_10.42.42.5(pid=29440): stdout: | (launched: 2022-12-09_11:03:16.422217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:18.130735 run osmo-stp_10.42.42.5(pid=29440): stderr: | 20221209110316619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110316619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110316619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110316620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110316620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110316620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110316620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:18.259738 run osmo-stp_10.42.42.5(pid=29440): stdout: | (launched: 2022-12-09_11:03:16.422217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:18.383689 run osmo-stp_10.42.42.5(pid=29440): stderr: | 20221209110316619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110316619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110316619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110316620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110316620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110316620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110316620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:18.530196 run patchelf(pid=29443): Terminating (SIGINT) 11:03:18.698557 run patchelf(pid=29443): Terminated: ok {rc=0} 11:03:18.820144 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29440): Process ended prematurely: osmo-stp_10.42.42.5(pid=29440) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29440)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:03:18.831000 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:03:18.858165 run osmo-hlr_10.42.42.2(pid=29437): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29437)] 11:03:18.905627 run osmo-hlr_10.42.42.2(pid=29437): stdout: | (launched: 2022-12-09_11:03:15.428004) 11:03:18.955628 run osmo-hlr_10.42.42.2(pid=29437): stderr: | 20221209110315599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110315599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110315599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110315599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110315599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110315599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110315611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110315620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110315620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110315620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:19.005891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29430): Terminating (SIGTERM) 11:03:19.045609 run iperf3-srv_10.42.42.10(pid=29431): Terminating (SIGTERM) 11:03:19.085198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29432): Terminating (SIGTERM) 11:03:19.124739 run iperf3-srv_10.42.42.10(pid=29433): Terminating (SIGTERM) 11:03:19.164152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29436): Terminating (SIGTERM) 11:03:19.203761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29439): Terminating (SIGTERM) 11:03:19.243321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29442): Terminating (SIGTERM) 11:03:19.282904 --- ParallelTerminationStrategy: PID 29430 died... 11:03:19.302016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29430): Terminated: ok {rc=0} 11:03:19.345912 --- ParallelTerminationStrategy: PID 29431 died... 11:03:19.364493 run iperf3-srv_10.42.42.10(pid=29431): Terminated {rc=256} 11:03:19.408168 --- ParallelTerminationStrategy: PID 29432 died... 11:03:19.426792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29432): Terminated: ok {rc=0} 11:03:19.470426 --- ParallelTerminationStrategy: PID 29433 died... 11:03:19.488890 run iperf3-srv_10.42.42.10(pid=29433): Terminated {rc=256} 11:03:19.532324 --- ParallelTerminationStrategy: PID 29436 died... 11:03:19.550849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29436): Terminated: ok {rc=0} 11:03:19.594986 --- ParallelTerminationStrategy: PID 29439 died... 11:03:19.613557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29439): Terminated: ok {rc=0} 11:03:19.657267 --- ParallelTerminationStrategy: PID 29442 died... 11:03:19.675970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29442): Terminated: ok {rc=0} 11:03:19.762046 bus /gobi_0: Setting Powered False 11:03:20.863377 bus /gobi_0: Setting Powered False 11:03:21.979232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:03:23.125860 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.138001 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:03:23.187828 tst iperf3.py: using LAC 21017 11:03:23.306984 tst iperf3.py: using RAC 107 11:03:23.426639 tst iperf3.py: using CellId 21017 11:03:23.546638 tst iperf3.py: using BVCI 21018 11:03:23.657386 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.668843 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.680142 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.691489 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.702744 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.713900 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.725137 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.736104 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:23.747350 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:23.868891 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:03:24.086164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:24.408803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29444): Launched 11:03:24.688794 run iperf3-srv_10.42.42.10(pid=29445): Launched 11:03:24.809811 tst iperf3.py:8: start network... 11:03:25.026362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:25.526802 run create_hlr_db(pid=29446): Launched 11:03:25.650231 bus /gobi_6: Setting Powered False 11:03:26.714393 run create_hlr_db(pid=29446): Terminated: ok {rc=0} 11:03:27.148120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29448): Launched 11:03:27.449077 run osmo-hlr_10.42.42.2(pid=29449): Launched 11:03:27.564198 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:28.101223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29451): Launched 11:03:28.402028 run osmo-stp_10.42.42.5(pid=29452): Launched 11:03:28.516815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:29.037768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29454): Launched 11:03:29.153525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:29.408543 run patchelf(pid=29455): Launched 11:03:29.576095 run osmo-stp_10.42.42.5(pid=29452): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29452)] 11:03:29.703521 run osmo-stp_10.42.42.5(pid=29452): stdout: | (launched: 2022-12-09_11:03:28.346339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:29.832250 run osmo-stp_10.42.42.5(pid=29452): stderr: | 20221209110328511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110328511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110328511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110328512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110328512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110328513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110328513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:29.960938 run osmo-stp_10.42.42.5(pid=29452): stdout: | (launched: 2022-12-09_11:03:28.346339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:30.084544 run osmo-stp_10.42.42.5(pid=29452): stderr: | 20221209110328511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110328511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110328511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110328512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110328512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110328513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110328513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:30.230762 run patchelf(pid=29455): Terminating (SIGINT) 11:03:30.399648 run patchelf(pid=29455): Terminated: ok {rc=0} 11:03:30.521266 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29452): Process ended prematurely: osmo-stp_10.42.42.5(pid=29452) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29452)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:03:30.530865 tst iperf3.py:8: Test FAILED (7.4 sec) 11:03:30.558303 run osmo-hlr_10.42.42.2(pid=29449): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29449)] 11:03:30.606493 run osmo-hlr_10.42.42.2(pid=29449): stdout: | (launched: 2022-12-09_11:03:27.393995) 11:03:30.656446 run osmo-hlr_10.42.42.2(pid=29449): stderr: | 20221209110327567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110327567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110327567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110327567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110327567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110327567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110327579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110327587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110327587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110327588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:30.706743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29444): Terminating (SIGTERM) 11:03:30.746895 run iperf3-srv_10.42.42.10(pid=29445): Terminating (SIGTERM) 11:03:30.787170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29448): Terminating (SIGTERM) 11:03:30.827428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29451): Terminating (SIGTERM) 11:03:30.887079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29454): Terminating (SIGTERM) 11:03:30.938192 --- ParallelTerminationStrategy: PID 29444 died... 11:03:30.957510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29444): Terminated: ok {rc=0} 11:03:31.002752 --- ParallelTerminationStrategy: PID 29445 died... 11:03:31.022792 run iperf3-srv_10.42.42.10(pid=29445): Terminated {rc=256} 11:03:31.081895 --- ParallelTerminationStrategy: PID 29448 died... 11:03:31.101363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29448): Terminated: ok {rc=0} 11:03:31.146501 --- ParallelTerminationStrategy: PID 29451 died... 11:03:31.166094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29451): Terminated: ok {rc=0} 11:03:31.211128 --- ParallelTerminationStrategy: PID 29454 died... 11:03:31.230654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29454): Terminated: ok {rc=0} 11:03:31.317037 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:03:32.459891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:32.471853 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:03:32.524371 tst iperf3m4.py: using LAC 21018 11:03:32.642313 tst iperf3m4.py: using RAC 108 11:03:32.771156 tst iperf3m4.py: using CellId 21018 11:03:32.898122 tst iperf3m4.py: using BVCI 21019 11:03:33.017762 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.029901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.041961 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.054343 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.066718 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.079151 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.091349 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.103305 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:33.115891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:33.233480 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:33.354038 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:33.470627 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:33.589436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:03:33.808198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:34.133063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29456): Launched 11:03:34.414529 run iperf3-srv_10.42.42.10(pid=29457): Launched 11:03:34.537829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:03:34.754055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:35.078726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Launched 11:03:35.360930 run iperf3-srv_10.42.42.10(pid=29459): Launched 11:03:35.483623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:03:35.699398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:36.023491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29460): Launched 11:03:36.306532 run iperf3-srv_10.42.42.10(pid=29461): Launched 11:03:36.429417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:03:36.645068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:36.968289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Launched 11:03:37.249682 run iperf3-srv_10.42.42.10(pid=29463): Launched 11:03:37.372622 tst iperf3m4.py:8: start network... 11:03:37.590849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:38.091368 run create_hlr_db(pid=29464): Launched 11:03:38.214716 bus /gobi_6: Setting Powered False 11:03:39.278132 run create_hlr_db(pid=29464): Terminated: ok {rc=0} 11:03:39.727143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Launched 11:03:40.047200 run osmo-hlr_10.42.42.2(pid=29467): Launched 11:03:40.164866 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:40.685024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Launched 11:03:40.988121 run osmo-stp_10.42.42.5(pid=29470): Launched 11:03:41.103992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:41.625121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Launched 11:03:41.739563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:41.994474 run patchelf(pid=29473): Launched 11:03:42.161777 run osmo-stp_10.42.42.5(pid=29470): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] 11:03:42.288797 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-09_11:03:40.931708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:42.417350 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221209110341100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110341100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110341100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110341101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110341101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110341102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110341102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:42.545897 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-09_11:03:40.931708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:42.668762 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221209110341100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110341100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110341100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110341101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110341101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110341102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110341102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:42.814502 run patchelf(pid=29473): Terminating (SIGINT) 11:03:42.982690 run patchelf(pid=29473): Terminated: ok {rc=0} 11:03:43.104220 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:03:43.114190 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:03:43.142071 run osmo-hlr_10.42.42.2(pid=29467): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29467)] 11:03:43.189374 run osmo-hlr_10.42.42.2(pid=29467): stdout: | (launched: 2022-12-09_11:03:39.991353) 11:03:43.238398 run osmo-hlr_10.42.42.2(pid=29467): stderr: | 20221209110340161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110340161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110340161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110340161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110340161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110340161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110340173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110340181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110340181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110340182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:43.287817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29456): Terminating (SIGTERM) 11:03:43.326942 run iperf3-srv_10.42.42.10(pid=29457): Terminating (SIGTERM) 11:03:43.366142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Terminating (SIGTERM) 11:03:43.405397 run iperf3-srv_10.42.42.10(pid=29459): Terminating (SIGTERM) 11:03:43.444533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29460): Terminating (SIGTERM) 11:03:43.483841 run iperf3-srv_10.42.42.10(pid=29461): Terminating (SIGTERM) 11:03:43.522952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Terminating (SIGTERM) 11:03:43.562309 run iperf3-srv_10.42.42.10(pid=29463): Terminating (SIGTERM) 11:03:43.601529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminating (SIGTERM) 11:03:43.641120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminating (SIGTERM) 11:03:43.680502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Terminating (SIGTERM) 11:03:43.720424 --- ParallelTerminationStrategy: PID 29456 died... 11:03:43.739345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29456): Terminated: ok {rc=0} 11:03:43.783494 --- ParallelTerminationStrategy: PID 29457 died... 11:03:43.802179 run iperf3-srv_10.42.42.10(pid=29457): Terminated {rc=256} 11:03:43.846100 --- ParallelTerminationStrategy: PID 29458 died... 11:03:43.864667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Terminated: ok {rc=0} 11:03:43.909079 --- ParallelTerminationStrategy: PID 29459 died... 11:03:43.927703 run iperf3-srv_10.42.42.10(pid=29459): Terminated {rc=256} 11:03:43.971656 --- ParallelTerminationStrategy: PID 29460 died... 11:03:43.990287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29460): Terminated: ok {rc=0} 11:03:44.034227 --- ParallelTerminationStrategy: PID 29461 died... 11:03:44.052895 run iperf3-srv_10.42.42.10(pid=29461): Terminated {rc=256} 11:03:44.096926 --- ParallelTerminationStrategy: PID 29462 died... 11:03:44.115973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Terminated: ok {rc=0} 11:03:44.159804 --- ParallelTerminationStrategy: PID 29463 died... 11:03:44.178414 run iperf3-srv_10.42.42.10(pid=29463): Terminated {rc=256} 11:03:44.222716 --- ParallelTerminationStrategy: PID 29466 died... 11:03:44.241435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminated: ok {rc=0} 11:03:44.285403 --- ParallelTerminationStrategy: PID 29469 died... 11:03:44.304001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminated: ok {rc=0} 11:03:44.347987 --- ParallelTerminationStrategy: PID 29472 died... 11:03:44.366660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Terminated: ok {rc=0} 11:03:44.452749 bus /gobi_4: Setting Powered False 11:03:45.553723 bus /gobi_4: Setting Powered False 11:03:46.669482 bus /gobi_1: Setting Powered False 11:03:47.763439 bus /gobi_1: Setting Powered False 11:03:48.880338 bus /gobi_0: Setting Powered False 11:03:49.979276 bus /gobi_0: Setting Powered False 11:03:51.095295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:03:52.198909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.211147 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:03:52.261108 tst ping.py: using LAC 21019 11:03:52.378233 tst ping.py: using RAC 109 11:03:52.496223 tst ping.py: using CellId 21019 11:03:52.611676 tst ping.py: using BVCI 21020 11:03:52.720147 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.731638 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.742901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.754080 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.765213 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.776396 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.787685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:03:52.798784 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:03:52.913047 tst ping.py:19: start network... 11:03:53.110834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:53.571209 run create_hlr_db(pid=29474): Launched 11:03:53.693576 bus /gobi_6: Setting Powered False 11:03:54.752560 run create_hlr_db(pid=29474): Terminated: ok {rc=0} 11:03:55.173122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29476): Launched 11:03:55.469774 run osmo-hlr_10.42.42.2(pid=29477): Launched 11:03:55.581469 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:56.092252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29479): Launched 11:03:56.388855 run osmo-stp_10.42.42.5(pid=29480): Launched 11:03:56.501834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:57.024006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29482): Launched 11:03:57.137859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:57.388121 run patchelf(pid=29483): Launched 11:03:57.554028 run osmo-stp_10.42.42.5(pid=29480): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29480)] 11:03:57.679828 run osmo-stp_10.42.42.5(pid=29480): stdout: | (launched: 2022-12-09_11:03:56.333817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:57.806546 run osmo-stp_10.42.42.5(pid=29480): stderr: | 20221209110356498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110356498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110356498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110356498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110356499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110356499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110356499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:57.933631 run osmo-stp_10.42.42.5(pid=29480): stdout: | (launched: 2022-12-09_11:03:56.333817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:58.055160 run osmo-stp_10.42.42.5(pid=29480): stderr: | 20221209110356498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110356498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110356498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110356498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110356499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110356499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110356499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:58.198787 run patchelf(pid=29483): Terminating (SIGINT) 11:03:58.365312 run patchelf(pid=29483): Terminated: ok {rc=0} 11:03:58.484646 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29480): Process ended prematurely: osmo-stp_10.42.42.5(pid=29480) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29480)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:03:58.493950 tst ping.py:22: Test FAILED (6.3 sec) 11:03:58.521058 run osmo-hlr_10.42.42.2(pid=29477): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29477)] 11:03:58.568908 run osmo-hlr_10.42.42.2(pid=29477): stdout: | (launched: 2022-12-09_11:03:55.414710) 11:03:58.618366 run osmo-hlr_10.42.42.2(pid=29477): stderr: | 20221209110355586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110355586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110355586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110355587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110355587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110355587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110355597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110355606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110355606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110355606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:58.668712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29476): Terminating (SIGTERM) 11:03:58.708529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29479): Terminating (SIGTERM) 11:03:58.748381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29482): Terminating (SIGTERM) 11:03:58.788352 --- ParallelTerminationStrategy: PID 29476 died... 11:03:58.807554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29476): Terminated: ok {rc=0} 11:03:58.851847 --- ParallelTerminationStrategy: PID 29479 died... 11:03:58.870469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29479): Terminated: ok {rc=0} 11:03:58.914378 --- ParallelTerminationStrategy: PID 29482 died... 11:03:58.933157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29482): Terminated: ok {rc=0} 11:03:59.019243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:04:00.108741 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.120911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:04:00.172174 tst ping_idle_ping.py: using LAC 21020 11:04:00.289719 tst ping_idle_ping.py: using RAC 110 11:04:00.407172 tst ping_idle_ping.py: using CellId 21020 11:04:00.524891 tst ping_idle_ping.py: using BVCI 21021 11:04:00.632669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.644306 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.655684 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.667154 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.678344 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.689519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.700741 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:04:00.711974 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:04:00.830987 tst ping_idle_ping.py:24: start network... 11:04:01.067008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:01.541606 run create_hlr_db(pid=29484): Launched 11:04:01.693775 bus /gobi_6: Setting Powered False 11:04:02.753159 run create_hlr_db(pid=29484): Terminated: ok {rc=0} 11:04:03.169080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29486): Launched 11:04:03.467166 run osmo-hlr_10.42.42.2(pid=29487): Launched 11:04:03.579607 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:04.103240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29489): Launched 11:04:04.400752 run osmo-stp_10.42.42.5(pid=29490): Launched 11:04:04.513209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:05.029207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29492): Launched 11:04:05.142664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:05.393716 run patchelf(pid=29493): Launched 11:04:05.560503 run osmo-stp_10.42.42.5(pid=29490): ERR: Terminated: ERROR {rc=1} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29490)] 11:04:05.687052 run osmo-stp_10.42.42.5(pid=29490): stdout: | (launched: 2022-12-09_11:04:04.345452) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:05.815026 run osmo-stp_10.42.42.5(pid=29490): stderr: | 20221209110404511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110404511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110404511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110404511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110404512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110404512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110404512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:05.942746 run osmo-stp_10.42.42.5(pid=29490): stdout: | (launched: 2022-12-09_11:04:04.345452) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:06.065371 run osmo-stp_10.42.42.5(pid=29490): stderr: | 20221209110404511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110404511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110404511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110404511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110404512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110404512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110404512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:06.210885 run patchelf(pid=29493): Terminating (SIGINT) 11:04:06.378767 run patchelf(pid=29493): Terminated: ok {rc=0} 11:04:06.499347 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29490): Process ended prematurely: osmo-stp_10.42.42.5(pid=29490) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29490)] [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:04:06.508540 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:04:06.535527 run osmo-hlr_10.42.42.2(pid=29487): ERR: Terminated: ERROR {rc=237} [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29487)] 11:04:06.583580 run osmo-hlr_10.42.42.2(pid=29487): stdout: | (launched: 2022-12-09_11:04:03.412239) 11:04:06.633925 run osmo-hlr_10.42.42.2(pid=29487): stderr: | 20221209110403585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110403585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110403585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110403585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110403585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110403585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110403598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110403607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110403607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110403607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:06.684153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29486): Terminating (SIGTERM) 11:04:06.724034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29489): Terminating (SIGTERM) 11:04:06.764124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29492): Terminating (SIGTERM) 11:04:06.804335 --- ParallelTerminationStrategy: PID 29486 died... 11:04:06.823760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29486): Terminated: ok {rc=0} 11:04:06.867993 --- ParallelTerminationStrategy: PID 29489 died... 11:04:06.886776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29489): Terminated: ok {rc=0} 11:04:06.930824 --- ParallelTerminationStrategy: PID 29492 died... 11:04:06.949589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29492): Terminated: ok {rc=0} 11:04:07.033179 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 11:04:08.357557 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:04:08.365978 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:04:08.400124 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:04:08.435622 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:04:08.491085 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:04:08.524361 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:04:08.559710 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:04:09.119914 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2358 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:04:09.125594 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.137717 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:04:09.211904 tst switch_tch_pdch.py: using LAC 21021 11:04:09.341402 tst switch_tch_pdch.py: using RAC 111 11:04:09.478324 tst switch_tch_pdch.py: using CellId 21021 11:04:09.602902 tst switch_tch_pdch.py: using BVCI 21022 11:04:09.718749 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.730820 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.742744 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.755844 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.767774 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.779967 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.792381 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:04:09.804839 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:04:09.924227 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:04:10.039762 tst switch_tch_pdch.py:51: start network... 11:04:10.236384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:10.695024 run create_hlr_db(pid=29497): Launched 11:04:10.817079 bus /gobi_6: Setting Powered False 11:04:11.875736 run create_hlr_db(pid=29497): Terminated: ok {rc=0} 11:04:12.312039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29499): Launched 11:04:12.628586 run osmo-hlr_10.42.42.2(pid=29500): Launched 11:04:12.752529 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:13.299995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29502): Launched 11:04:13.617722 run osmo-stp_10.42.42.5(pid=29503): Launched 11:04:13.740765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:14.290701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29505): Launched 11:04:14.413331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:14.681165 run patchelf(pid=29506): Launched 11:04:14.859756 run osmo-stp_10.42.42.5(pid=29503): ERR: Terminated: ERROR {rc=1} [trial-2358↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29503)] 11:04:14.994597 run osmo-stp_10.42.42.5(pid=29503): stdout: | (launched: 2022-12-09_11:04:13.559787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:15.131587 run osmo-stp_10.42.42.5(pid=29503): stderr: | 20221209110413746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110413747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110413747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110413747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110413748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110413748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110413748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:15.268187 run osmo-stp_10.42.42.5(pid=29503): stdout: | (launched: 2022-12-09_11:04:13.559787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:15.399351 run osmo-stp_10.42.42.5(pid=29503): stderr: | 20221209110413746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110413747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110413747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110413747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110413748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110413748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110413748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:15.554967 run patchelf(pid=29506): Terminating (SIGINT) 11:04:15.732916 run patchelf(pid=29506): Terminated: ok {rc=0} 11:04:15.865103 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29503): Process ended prematurely: osmo-stp_10.42.42.5(pid=29503) [trial-2358↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29503)] [trial-2358↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:04:15.880428 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:04:15.909901 run osmo-hlr_10.42.42.2(pid=29500): ERR: Terminated: ERROR {rc=237} [trial-2358↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29500)] 11:04:15.961840 run osmo-hlr_10.42.42.2(pid=29500): stdout: | (launched: 2022-12-09_11:04:12.570595) 11:04:16.013900 run osmo-hlr_10.42.42.2(pid=29500): stderr: | 20221209110412764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110412764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110412765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110412765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110412765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110412765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110412777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110412785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110412786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110412786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:16.066255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29499): Terminating (SIGTERM) 11:04:16.108845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29502): Terminating (SIGTERM) 11:04:16.154047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29505): Terminating (SIGTERM) 11:04:16.198188 --- ParallelTerminationStrategy: PID 29499 died... 11:04:16.218859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29499): Terminated: ok {rc=0} 11:04:16.267021 --- ParallelTerminationStrategy: PID 29502 died... 11:04:16.286394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29502): Terminated: ok {rc=0} 11:04:16.333118 --- ParallelTerminationStrategy: PID 29505 died... 11:04:16.353808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29505): Terminated: ok {rc=0} 11:04:16.450337 bus /gobi_0: Setting Powered False 11:04:17.561321 bus /gobi_0: Setting Powered False 11:04:18.678246 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2358 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 nitb_smpp --------------------------------------------------------------------- 11:04:19.936747 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:04:19.939611 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 11:04:19.960744 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 11:04:19.968888 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 11:04:20.005728 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 11:04:20.027209 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 11:04:20.034521 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 11:04:20.553791 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2358 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:04:20.559198 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:04:20.578702 tst esme_connect_policy_acceptall.py: using MSISDN 7170 11:04:20.721692 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:04:21.330117 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29510): Launched 11:04:21.654838 run osmo-nitb_10.42.42.2(pid=29511): Launched 11:04:21.836830 run osmo-nitb_10.42.42.2(pid=29511): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29511)] 11:04:21.982256 run osmo-nitb_10.42.42.2(pid=29511): stdout: | (launched: 2022-12-09_11:04:21.595806) 11:04:22.129521 run osmo-nitb_10.42.42.2(pid=29511): stderr: | (launched: 2022-12-09_11:04:21.644004) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:22.275873 run osmo-nitb_10.42.42.2(pid=29511): stdout: | (launched: 2022-12-09_11:04:21.595806) 11:04:22.417058 run osmo-nitb_10.42.42.2(pid=29511): stderr: | (launched: 2022-12-09_11:04:21.644004) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29511): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29511) [trial-2358↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29511)] 11:04:22.779287 tst osmo-nitb_10.42.42.2(pid=29511): stdout: | (launched: 2022-12-09_11:04:21.595806) 11:04:22.910815 tst osmo-nitb_10.42.42.2(pid=29511): stderr: | (launched: 2022-12-09_11:04:21.644004) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:23.066144 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=29511): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29511) [trial-2358↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29511)] [trial-2358↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 11:04:23.075446 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 11:04:23.082660 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29510): Terminating (SIGTERM) 11:04:23.294680 --- ParallelTerminationStrategy: PID 29510 died... 11:04:23.316677 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29510): Terminated: ok {rc=0} ---------------------------------------------- trial-2358 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 11:04:23.368564 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:04:23.389270 tst esme_connect_policy_closed.py: using MSISDN 7171 11:04:23.520122 tst esme_connect_policy_closed.py: using MSISDN 7172 11:04:23.638253 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:04:24.246968 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29512): Launched 11:04:24.574297 run osmo-nitb_10.42.42.2(pid=29513): Launched 11:04:24.750585 run osmo-nitb_10.42.42.2(pid=29513): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29513)] 11:04:24.885153 run osmo-nitb_10.42.42.2(pid=29513): stdout: | (launched: 2022-12-09_11:04:24.515102) 11:04:25.021092 run osmo-nitb_10.42.42.2(pid=29513): stderr: | (launched: 2022-12-09_11:04:24.563420) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:25.157135 run osmo-nitb_10.42.42.2(pid=29513): stdout: | (launched: 2022-12-09_11:04:24.515102) 11:04:25.286792 run osmo-nitb_10.42.42.2(pid=29513): stderr: | (launched: 2022-12-09_11:04:24.563420) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:25.442351 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=29513): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29513) [trial-2358↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29513)] [trial-2358↪nitb_smpp↪esme_connect_policy_closed.py:24] 11:04:25.451618 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 11:04:25.458831 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29512): Terminating (SIGTERM) 11:04:25.671284 --- ParallelTerminationStrategy: PID 29512 died... 11:04:25.693066 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29512): Terminated: ok {rc=0} ---------------------------------------------- trial-2358 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:04:25.745207 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:04:25.756852 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:04:25.798349 tst esme_ms_sms_storeforward.py: using LAC 21022 11:04:25.926837 tst esme_ms_sms_storeforward.py: using RAC 112 11:04:26.053645 tst esme_ms_sms_storeforward.py: using CellId 21022 11:04:26.180181 tst esme_ms_sms_storeforward.py: using BVCI 21023 11:04:26.299362 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:04:26.426959 tst esme_ms_sms_storeforward.py: using MSISDN 7173 11:04:26.547346 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 11:04:26.768629 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:04:27.438688 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29514): Launched 11:04:27.768920 run osmo-nitb_10.42.42.2(pid=29515): Launched 11:04:27.948283 run osmo-nitb_10.42.42.2(pid=29515): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29515)] 11:04:28.084320 run osmo-nitb_10.42.42.2(pid=29515): stdout: | (launched: 2022-12-09_11:04:27.708915) 11:04:28.221262 run osmo-nitb_10.42.42.2(pid=29515): stderr: | (launched: 2022-12-09_11:04:27.758137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:28.358490 run osmo-nitb_10.42.42.2(pid=29515): stdout: | (launched: 2022-12-09_11:04:27.708915) 11:04:28.489361 run osmo-nitb_10.42.42.2(pid=29515): stderr: | (launched: 2022-12-09_11:04:27.758137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:28.645756 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=29515): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29515) [trial-2358↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29515)] [trial-2358↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 11:04:28.655040 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 11:04:28.662238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29514): Terminating (SIGTERM) 11:04:28.873797 --- ParallelTerminationStrategy: PID 29514 died... 11:04:28.895697 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29514): Terminated: ok {rc=0} 11:04:28.984501 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:04:30.072142 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:04:30.083983 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:04:30.122538 tst esme_ms_sms_transaction.py: using LAC 21023 11:04:30.252358 tst esme_ms_sms_transaction.py: using RAC 113 11:04:30.380359 tst esme_ms_sms_transaction.py: using CellId 21023 11:04:30.510299 tst esme_ms_sms_transaction.py: using BVCI 21024 11:04:30.623175 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:04:30.758468 tst esme_ms_sms_transaction.py: using MSISDN 7174 11:04:30.882882 tst esme_ms_sms_transaction.py:18: start nitb and bts... 11:04:31.153799 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:04:31.820032 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29516): Launched 11:04:32.143481 run osmo-nitb_10.42.42.2(pid=29517): Launched 11:04:32.326830 run osmo-nitb_10.42.42.2(pid=29517): ERR: Terminated: ERROR {rc=2} [trial-2358↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29517)] 11:04:32.463859 run osmo-nitb_10.42.42.2(pid=29517): stdout: | (launched: 2022-12-09_11:04:32.086498) 11:04:32.601997 run osmo-nitb_10.42.42.2(pid=29517): stderr: | (launched: 2022-12-09_11:04:32.132606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:32.740561 run osmo-nitb_10.42.42.2(pid=29517): stdout: | (launched: 2022-12-09_11:04:32.086498) 11:04:32.874823 run osmo-nitb_10.42.42.2(pid=29517): stderr: | (launched: 2022-12-09_11:04:32.132606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29517): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29517) [trial-2358↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29517)] 11:04:33.272690 tst osmo-nitb_10.42.42.2(pid=29517): stdout: | (launched: 2022-12-09_11:04:32.086498) 11:04:33.395482 tst osmo-nitb_10.42.42.2(pid=29517): stderr: | (launched: 2022-12-09_11:04:32.132606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:04:33.540603 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=29517): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29517) [trial-2358↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29517)] [trial-2358↪nitb_smpp↪esme_ms_sms_transaction.py:21] 11:04:33.549723 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 11:04:33.556528 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29516): Terminating (SIGTERM) 11:04:33.765647 --- ParallelTerminationStrategy: PID 29516 died... 11:04:33.787773 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29516): Terminated: ok {rc=0} 11:04:33.872791 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 smpp --------------------------------------------------------------------- 11:04:35.038450 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:04:35.041290 tst smpp: Verifying 1 x bts (candidates: 11) 11:04:35.062392 tst smpp: Verifying 6 x ip_address (candidates: 9) 11:04:35.090329 tst smpp: Verifying 1 x modem (candidates: 12) 11:04:35.126622 tst smpp: Reserving 1 x bts (candidates: 11) 11:04:35.147611 tst smpp: Reserving 6 x ip_address (candidates: 9) 11:04:35.175073 tst smpp: Reserving 1 x modem (candidates: 12) 11:04:35.702462 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:04:35.707689 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:35.718730 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:35.729804 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:35.740750 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:35.761135 tst esme_connect_policy_acceptall.py: using MSISDN 7175 11:04:35.880770 run osmo-stp_10.42.42.4: Starting osmo-stp 11:04:36.437668 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29522): Launched 11:04:36.766267 run osmo-stp_10.42.42.4(pid=29523): Launched 11:04:36.891945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:37.397774 run create_hlr_db(pid=29524): Launched 11:04:37.523883 bus /sierra_2: Setting Powered False 11:04:38.588577 run create_hlr_db(pid=29524): Terminated: ok {rc=0} 11:04:39.042134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29527): Launched 11:04:39.369402 run osmo-hlr_10.42.42.2(pid=29528): Launched 11:04:39.494164 run osmo-msc_10.42.42.5: Starting osmo-msc 11:04:40.086795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29530): Launched 11:04:40.413641 run osmo-msc_10.42.42.5(pid=29531): Launched 11:04:40.597744 run osmo-hlr_10.42.42.2(pid=29528): ERR: Terminated: ERROR {rc=237} [trial-2358↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29528)] 11:04:40.735708 run osmo-hlr_10.42.42.2(pid=29528): stdout: | (launched: 2022-12-09_11:04:39.309067) 11:04:40.876068 run osmo-hlr_10.42.42.2(pid=29528): stderr: | 20221209110439503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110439503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110439515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110439523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110439524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110439524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:41.012251 run osmo-hlr_10.42.42.2(pid=29528): stdout: | (launched: 2022-12-09_11:04:39.309067) 11:04:41.141872 run osmo-hlr_10.42.42.2(pid=29528): stderr: | 20221209110439503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110439503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110439503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110439515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110439523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110439524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110439524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:41.297082 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=29528): Process ended prematurely: osmo-hlr_10.42.42.2(pid=29528) [trial-2358↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29528)] [trial-2358↪smpp↪esme_connect_policy_acceptall.py:23] 11:04:41.306328 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 11:04:41.334588 run osmo-msc_10.42.42.5(pid=29531): ERR: Terminated: ERROR {rc=9} [trial-2358↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=29531)] 11:04:41.386047 run osmo-msc_10.42.42.5(pid=29531): stdout: | (launched: 2022-12-09_11:04:40.353844) 11:04:41.438969 run osmo-msc_10.42.42.5(pid=29531): stderr: | 20221209110440714 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209110440714 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209110440714 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110440714 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209110440714 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209110440714 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209110440714 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209110440714 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209110440715 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:04:41.492133 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29522): Terminating (SIGTERM) 11:04:41.534727 run osmo-stp_10.42.42.4(pid=29523): Terminating (SIGTERM) 11:04:41.577302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29527): Terminating (SIGTERM) 11:04:41.621185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29530): Terminating (SIGTERM) 11:04:41.665744 --- ParallelTerminationStrategy: PID 29522 died... 11:04:41.686535 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29522): Terminated: ok {rc=0} 11:04:41.736210 --- ParallelTerminationStrategy: PID 29523 died... 11:04:41.756299 run osmo-stp_10.42.42.4(pid=29523): Terminated: ok {rc=0} 11:04:41.803966 --- ParallelTerminationStrategy: PID 29527 died... 11:04:41.824007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29527): Terminated: ok {rc=0} 11:04:41.871795 --- ParallelTerminationStrategy: PID 29530 died... 11:04:41.891966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29530): Terminated: ok {rc=0} ---------------------------------------------- trial-2358 smpp esme_connect_policy_closed.py ---------------------------------------------- 11:04:41.944651 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:41.956269 tst smpp: Using 1 x bts (candidates: 1) 11:04:41.993215 tst esme_connect_policy_closed.py: using LAC 21024 11:04:42.127165 tst esme_connect_policy_closed.py: using RAC 114 11:04:42.254382 tst esme_connect_policy_closed.py: using CellId 21024 11:04:42.382785 tst esme_connect_policy_closed.py: using BVCI 21025 11:04:42.502022 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:42.512854 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:42.523799 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:42.543210 tst esme_connect_policy_closed.py: using MSISDN 7176 11:04:42.663323 tst esme_connect_policy_closed.py: using MSISDN 7177 11:04:42.783526 run osmo-stp_10.42.42.4: Starting osmo-stp 11:04:43.339583 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29534): Launched 11:04:43.668270 run osmo-stp_10.42.42.4(pid=29535): Launched 11:04:43.795020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:44.302905 run create_hlr_db(pid=29536): Launched 11:04:45.488456 run create_hlr_db(pid=29536): Terminated: ok {rc=0} 11:04:45.837323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29538): Launched 11:04:46.192065 run osmo-hlr_10.42.42.2(pid=29539): Launched 11:04:46.487490 run osmo-msc_10.42.42.5: Starting osmo-msc 11:04:47.113518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29541): Launched 11:04:47.455138 run osmo-msc_10.42.42.5(pid=29542): Launched 11:04:47.639763 run osmo-hlr_10.42.42.2(pid=29539): ERR: Terminated: ERROR {rc=237} [trial-2358↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29539)] 11:04:47.778106 run osmo-hlr_10.42.42.2(pid=29539): stdout: | (launched: 2022-12-09_11:04:46.131074) 11:04:47.917113 run osmo-hlr_10.42.42.2(pid=29539): stderr: | 20221209110446331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110446331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110446347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110446364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110446364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110446364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:48.056513 run osmo-hlr_10.42.42.2(pid=29539): stdout: | (launched: 2022-12-09_11:04:46.131074) 11:04:48.187280 run osmo-hlr_10.42.42.2(pid=29539): stderr: | 20221209110446331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110446331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110446331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110446347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110446364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110446364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110446364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:48.343166 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=29539): Process ended prematurely: osmo-hlr_10.42.42.2(pid=29539) [trial-2358↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29539)] [trial-2358↪smpp↪esme_connect_policy_closed.py:31] 11:04:48.352330 tst esme_connect_policy_closed.py:31: Test FAILED (6.4 sec) 11:04:48.380854 run osmo-msc_10.42.42.5(pid=29542): ERR: Terminated: ERROR {rc=9} [trial-2358↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=29542)] 11:04:48.432310 run osmo-msc_10.42.42.5(pid=29542): stdout: | (launched: 2022-12-09_11:04:47.395277) 11:04:48.485374 run osmo-msc_10.42.42.5(pid=29542): stderr: | 20221209110447757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209110447757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209110447757 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110447757 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209110447757 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209110447757 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209110447757 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209110447758 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209110447758 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:04:48.538421 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29534): Terminating (SIGTERM) 11:04:48.580818 run osmo-stp_10.42.42.4(pid=29535): Terminating (SIGTERM) 11:04:48.623229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29538): Terminating (SIGTERM) 11:04:48.667497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29541): Terminating (SIGTERM) 11:04:48.713232 --- ParallelTerminationStrategy: PID 29534 died... 11:04:48.734465 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29534): Terminated: ok {rc=0} 11:04:48.784731 --- ParallelTerminationStrategy: PID 29535 died... 11:04:48.804607 run osmo-stp_10.42.42.4(pid=29535): Terminated: ok {rc=0} 11:04:48.851739 --- ParallelTerminationStrategy: PID 29538 died... 11:04:48.871585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29538): Terminated: ok {rc=0} 11:04:48.918613 --- ParallelTerminationStrategy: PID 29541 died... 11:04:48.938567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29541): Terminated: ok {rc=0} ---------------------------------------------- trial-2358 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:04:48.990751 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:49.002297 tst smpp: Using 1 x bts (candidates: 1) 11:04:49.039296 tst esme_ms_sms_storeforward.py: using LAC 21025 11:04:49.170310 tst esme_ms_sms_storeforward.py: using RAC 115 11:04:49.304332 tst esme_ms_sms_storeforward.py: using CellId 21025 11:04:49.432820 tst esme_ms_sms_storeforward.py: using BVCI 21026 11:04:49.552537 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:49.563656 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:49.574663 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:49.585804 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:49.596713 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:49.607939 tst smpp: Using 1 x modem (candidates: 1) 11:04:49.738845 tst esme_ms_sms_storeforward.py: using MSISDN 7178 11:04:49.851431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:50.326343 run create_hlr_db(pid=29545): Launched 11:04:51.508928 run create_hlr_db(pid=29545): Terminated: ok {rc=0} 11:04:51.832447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29547): Launched 11:04:52.138652 run osmo-hlr_10.42.42.2(pid=29548): Launched 11:04:52.255979 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:52.802394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29550): Launched 11:04:53.109719 run osmo-stp_10.42.42.5(pid=29551): Launched 11:04:53.227546 run osmo-msc_10.42.42.6: Starting osmo-msc 11:04:53.784633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29553): Launched 11:04:54.091940 run osmo-msc_10.42.42.6(pid=29554): Launched 11:04:54.263682 run osmo-stp_10.42.42.5(pid=29551): ERR: Terminated: ERROR {rc=1} [trial-2358↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29551)] 11:04:54.393747 run osmo-stp_10.42.42.5(pid=29551): stdout: | (launched: 2022-12-09_11:04:53.053203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:54.523248 run osmo-stp_10.42.42.5(pid=29551): stderr: | 20221209110453223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110453223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110453223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110453223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110453224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110453224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110453224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:54.650725 run osmo-stp_10.42.42.5(pid=29551): stdout: | (launched: 2022-12-09_11:04:53.053203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:54.772442 run osmo-stp_10.42.42.5(pid=29551): stderr: | 20221209110453223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110453223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110453223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110453223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110453224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110453224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110453224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:54.918337 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=29551): Process ended prematurely: osmo-stp_10.42.42.5(pid=29551) [trial-2358↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29551)] [trial-2358↪smpp↪esme_ms_sms_storeforward.py:30] 11:04:54.926706 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 11:04:54.952843 run osmo-hlr_10.42.42.2(pid=29548): ERR: Terminated: ERROR {rc=237} [trial-2358↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29548)] 11:04:55.000863 run osmo-hlr_10.42.42.2(pid=29548): stdout: | (launched: 2022-12-09_11:04:52.082289) 11:04:55.050759 run osmo-hlr_10.42.42.2(pid=29548): stderr: | 20221209110452257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110452257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110452257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110452257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110452257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110452258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110452270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110452281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110452281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110452281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:55.120319 run osmo-msc_10.42.42.6(pid=29554): ERR: Terminated: ERROR {rc=2} [trial-2358↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29554)] 11:04:55.168323 run osmo-msc_10.42.42.6(pid=29554): stdout: | (launched: 2022-12-09_11:04:54.035693) 11:04:55.218091 run osmo-msc_10.42.42.6(pid=29554): stderr: | 20221209110454302 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110454302 DLGLOBAL DEBUG validating counter group 0x7f59c73cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110454302 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110454302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110454302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110454303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110454305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110454305 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110454305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110454305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:04:55.268115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29547): Terminating (SIGTERM) 11:04:55.308207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29550): Terminating (SIGTERM) 11:04:55.348083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29553): Terminating (SIGTERM) 11:04:55.388337 --- ParallelTerminationStrategy: PID 29547 died... 11:04:55.407637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29547): Terminated: ok {rc=0} 11:04:55.452365 --- ParallelTerminationStrategy: PID 29550 died... 11:04:55.471207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29550): Terminated: ok {rc=0} 11:04:55.515872 --- ParallelTerminationStrategy: PID 29553 died... 11:04:55.534670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29553): Terminated: ok {rc=0} 11:04:55.621198 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:04:56.713086 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:56.724882 tst smpp: Using 1 x bts (candidates: 1) 11:04:56.767120 tst esme_ms_sms_transaction.py: using LAC 21026 11:04:56.900913 tst esme_ms_sms_transaction.py: using RAC 116 11:04:57.030351 tst esme_ms_sms_transaction.py: using CellId 21026 11:04:57.159573 tst esme_ms_sms_transaction.py: using BVCI 21027 11:04:57.279341 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:57.290388 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:57.301296 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:57.313065 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:57.324268 tst smpp: Using 1 x ip_address (candidates: 6) 11:04:57.335116 tst smpp: Using 1 x modem (candidates: 1) 11:04:57.462566 tst esme_ms_sms_transaction.py: using MSISDN 7179 11:04:57.574736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:58.048465 run create_hlr_db(pid=29556): Launched 11:04:58.174493 bus /sierra_2: Setting Powered False 11:04:59.235040 run create_hlr_db(pid=29556): Terminated: ok {rc=0} 11:04:59.662457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29558): Launched 11:04:59.970732 run osmo-hlr_10.42.42.2(pid=29559): Launched 11:05:00.088161 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:00.628427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Launched 11:05:00.950002 run osmo-stp_10.42.42.5(pid=29562): Launched 11:05:01.139949 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:01.839177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29567): Launched 11:05:02.187758 run osmo-msc_10.42.42.6(pid=29568): Launched 11:05:02.472647 run osmo-stp_10.42.42.5(pid=29562): ERR: Terminated: ERROR {rc=1} [trial-2358↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] 11:05:02.602989 run osmo-stp_10.42.42.5(pid=29562): stdout: | (launched: 2022-12-09_11:05:00.882875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:02.731629 run osmo-stp_10.42.42.5(pid=29562): stderr: | 20221209110501220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110501221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110501221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110501221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110501222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110501222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110501222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:02.859960 run osmo-stp_10.42.42.5(pid=29562): stdout: | (launched: 2022-12-09_11:05:00.882875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:02.982347 run osmo-stp_10.42.42.5(pid=29562): stderr: | 20221209110501220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110501221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110501221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110501221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110501222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110501222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110501222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:03.128352 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=29562): Process ended prematurely: osmo-stp_10.42.42.5(pid=29562) [trial-2358↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] [trial-2358↪smpp↪esme_ms_sms_transaction.py:28] 11:05:03.136749 tst esme_ms_sms_transaction.py:28: Test FAILED (6.4 sec) 11:05:03.163224 run osmo-hlr_10.42.42.2(pid=29559): ERR: Terminated: ERROR {rc=237} [trial-2358↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29559)] 11:05:03.211873 run osmo-hlr_10.42.42.2(pid=29559): stdout: | (launched: 2022-12-09_11:04:59.913274) 11:05:03.262191 run osmo-hlr_10.42.42.2(pid=29559): stderr: | 20221209110500086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110500086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110500086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110500086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110500087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110500087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110500099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110500107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110500107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110500107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:03.332486 run osmo-msc_10.42.42.6(pid=29568): ERR: Terminated: ERROR {rc=2} [trial-2358↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29568)] 11:05:03.381442 run osmo-msc_10.42.42.6(pid=29568): stdout: | (launched: 2022-12-09_11:05:02.126359) 11:05:03.431606 run osmo-msc_10.42.42.6(pid=29568): stderr: | 20221209110502481 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110502481 DLGLOBAL DEBUG validating counter group 0x7f54a9642c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110502481 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110502482 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110502482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110502482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110502484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110502484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110502484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110502484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:03.482116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29558): Terminating (SIGTERM) 11:05:03.522603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Terminating (SIGTERM) 11:05:03.562970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29567): Terminating (SIGTERM) 11:05:03.603447 --- ParallelTerminationStrategy: PID 29558 died... 11:05:03.622901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29558): Terminated: ok {rc=0} 11:05:03.667493 --- ParallelTerminationStrategy: PID 29561 died... 11:05:03.686719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Terminated: ok {rc=0} 11:05:03.731191 --- ParallelTerminationStrategy: PID 29567 died... 11:05:03.750016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29567): Terminated: ok {rc=0} 11:05:03.837469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 encryption --------------------------------------------------------------------- 11:05:05.032139 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:05.035345 tst encryption: Verifying 1 x bts (candidates: 11) 11:05:05.056199 tst encryption: Verifying 6 x ip_address (candidates: 9) 11:05:05.082458 tst encryption: Verifying 1 x modem (candidates: 12) 11:05:05.117022 tst encryption: Reserving 1 x bts (candidates: 11) 11:05:05.137738 tst encryption: Reserving 6 x ip_address (candidates: 9) 11:05:05.164857 tst encryption: Reserving 1 x modem (candidates: 12) 11:05:05.691824 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2358 encryption register_a5_0_authopt.py ---------------------------------------------- 11:05:05.743952 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:05.754454 tst encryption: Using 1 x bts (candidates: 1) 11:05:05.790238 tst register_a5_0_authopt.py: using LAC 21027 11:05:05.914771 tst register_a5_0_authopt.py: using RAC 117 11:05:06.038260 tst register_a5_0_authopt.py: using CellId 21027 11:05:06.161325 tst register_a5_0_authopt.py: using BVCI 21028 11:05:06.274973 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:06.285499 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:06.295825 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:06.306854 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:06.317652 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:06.328489 tst encryption: Using 1 x modem (candidates: 1) 11:05:06.442884 tst register_a5_0_authopt.py:8: start network... 11:05:06.650172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:07.129051 run create_hlr_db(pid=29573): Launched 11:05:07.255235 bus /sierra_2: Setting Powered False 11:05:08.315755 run create_hlr_db(pid=29573): Terminated: ok {rc=0} 11:05:08.767841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29575): Launched 11:05:09.100227 run osmo-hlr_10.42.42.2(pid=29576): Launched 11:05:09.226558 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:09.796254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29578): Launched 11:05:10.127089 run osmo-stp_10.42.42.5(pid=29579): Launched 11:05:10.255946 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:10.854267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29581): Launched 11:05:11.186715 run osmo-msc_10.42.42.6(pid=29582): Launched 11:05:11.371787 run osmo-stp_10.42.42.5(pid=29579): ERR: Terminated: ERROR {rc=1} [trial-2358↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29579)] 11:05:11.513439 run osmo-stp_10.42.42.5(pid=29579): stdout: | (launched: 2022-12-09_11:05:10.066636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:11.654128 run osmo-stp_10.42.42.5(pid=29579): stderr: | 20221209110510256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110510256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110510256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110510257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110510257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110510257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110510258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:11.793066 run osmo-stp_10.42.42.5(pid=29579): stdout: | (launched: 2022-12-09_11:05:10.066636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:11.925403 run osmo-stp_10.42.42.5(pid=29579): stderr: | 20221209110510256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110510256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110510256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110510257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110510257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110510257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110510258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:12.083853 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29579): Process ended prematurely: osmo-stp_10.42.42.5(pid=29579) [trial-2358↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29579)] [trial-2358↪encryption↪register_a5_0_authopt.py:8] 11:05:12.093862 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 11:05:12.122303 run osmo-hlr_10.42.42.2(pid=29576): ERR: Terminated: ERROR {rc=237} [trial-2358↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29576)] 11:05:12.173519 run osmo-hlr_10.42.42.2(pid=29576): stdout: | (launched: 2022-12-09_11:05:09.039558) 11:05:12.225943 run osmo-hlr_10.42.42.2(pid=29576): stderr: | 20221209110509237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110509237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110509237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110509237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110509238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110509238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110509250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110509259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110509259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110509259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:12.298856 run osmo-msc_10.42.42.6(pid=29582): ERR: Terminated: ERROR {rc=2} [trial-2358↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29582)] 11:05:12.349724 run osmo-msc_10.42.42.6(pid=29582): stdout: | (launched: 2022-12-09_11:05:11.125712) 11:05:12.402007 run osmo-msc_10.42.42.6(pid=29582): stderr: | 20221209110511444 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110511445 DLGLOBAL DEBUG validating counter group 0x7fa1ba095c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110511445 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110511445 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110511445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110511445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110511447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110511447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110511447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110511447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:12.454927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29575): Terminating (SIGTERM) 11:05:12.497161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29578): Terminating (SIGTERM) 11:05:12.539555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29581): Terminating (SIGTERM) 11:05:12.582226 --- ParallelTerminationStrategy: PID 29575 died... 11:05:12.602305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29575): Terminated: ok {rc=0} 11:05:12.649498 --- ParallelTerminationStrategy: PID 29578 died... 11:05:12.669196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29578): Terminated: ok {rc=0} 11:05:12.715984 --- ParallelTerminationStrategy: PID 29581 died... 11:05:12.735459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29581): Terminated: ok {rc=0} 11:05:12.823978 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 encryption register_a5_0_authreq.py ---------------------------------------------- 11:05:13.977336 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:13.989104 tst encryption: Using 1 x bts (candidates: 1) 11:05:14.026528 tst register_a5_0_authreq.py: using LAC 21028 11:05:14.157573 tst register_a5_0_authreq.py: using RAC 118 11:05:14.280776 tst register_a5_0_authreq.py: using CellId 21028 11:05:14.413198 tst register_a5_0_authreq.py: using BVCI 21029 11:05:14.534023 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:14.545150 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:14.556139 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:14.567459 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:14.578725 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:14.590278 tst encryption: Using 1 x modem (candidates: 1) 11:05:14.712446 tst register_a5_0_authreq.py:8: start network... 11:05:14.935689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:15.449257 run create_hlr_db(pid=29584): Launched 11:05:15.575340 bus /sierra_2: Setting Powered False 11:05:16.669184 run create_hlr_db(pid=29584): Terminated: ok {rc=0} 11:05:17.166299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Launched 11:05:17.510097 run osmo-hlr_10.42.42.2(pid=29587): Launched 11:05:17.639049 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:18.210269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Launched 11:05:18.543723 run osmo-stp_10.42.42.5(pid=29590): Launched 11:05:18.671072 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:19.270157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29592): Launched 11:05:19.602580 run osmo-msc_10.42.42.6(pid=29593): Launched 11:05:19.789451 run osmo-stp_10.42.42.5(pid=29590): ERR: Terminated: ERROR {rc=1} [trial-2358↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] 11:05:19.929188 run osmo-stp_10.42.42.5(pid=29590): stdout: | (launched: 2022-12-09_11:05:18.482056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:20.070226 run osmo-stp_10.42.42.5(pid=29590): stderr: | 20221209110518672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110518672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110518672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110518673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110518673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110518673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110518673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:20.208623 run osmo-stp_10.42.42.5(pid=29590): stdout: | (launched: 2022-12-09_11:05:18.482056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:20.340555 run osmo-stp_10.42.42.5(pid=29590): stderr: | 20221209110518672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110518672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110518672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110518673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110518673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110518673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110518673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:20.498355 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29590): Process ended prematurely: osmo-stp_10.42.42.5(pid=29590) [trial-2358↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] [trial-2358↪encryption↪register_a5_0_authreq.py:8] 11:05:20.508219 tst register_a5_0_authreq.py:8: Test FAILED (6.6 sec) 11:05:20.537047 run osmo-hlr_10.42.42.2(pid=29587): ERR: Terminated: ERROR {rc=237} [trial-2358↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29587)] 11:05:20.587699 run osmo-hlr_10.42.42.2(pid=29587): stdout: | (launched: 2022-12-09_11:05:17.449086) 11:05:20.639833 run osmo-hlr_10.42.42.2(pid=29587): stderr: | 20221209110517646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110517646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110517646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110517646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110517646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110517646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110517659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110517670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110517670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110517670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:20.712625 run osmo-msc_10.42.42.6(pid=29593): ERR: Terminated: ERROR {rc=2} [trial-2358↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29593)] 11:05:20.763072 run osmo-msc_10.42.42.6(pid=29593): stdout: | (launched: 2022-12-09_11:05:19.541756) 11:05:20.815837 run osmo-msc_10.42.42.6(pid=29593): stderr: | 20221209110519862 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110519862 DLGLOBAL DEBUG validating counter group 0x7f8c52519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110519862 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110519862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110519862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110519863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110519864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110519865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110519865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110519865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:20.868528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Terminating (SIGTERM) 11:05:20.911117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Terminating (SIGTERM) 11:05:20.953671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29592): Terminating (SIGTERM) 11:05:20.996516 --- ParallelTerminationStrategy: PID 29586 died... 11:05:21.016842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Terminated: ok {rc=0} 11:05:21.064484 --- ParallelTerminationStrategy: PID 29589 died... 11:05:21.084407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Terminated: ok {rc=0} 11:05:21.131519 --- ParallelTerminationStrategy: PID 29592 died... 11:05:21.151361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29592): Terminated: ok {rc=0} 11:05:21.239112 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 encryption register_a5_1_authreq.py ---------------------------------------------- 11:05:22.387644 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:22.398906 tst encryption: Using 1 x bts (candidates: 1) 11:05:22.436313 tst register_a5_1_authreq.py: using LAC 21029 11:05:22.559793 tst register_a5_1_authreq.py: using RAC 119 11:05:22.683088 tst register_a5_1_authreq.py: using CellId 21029 11:05:22.805880 tst register_a5_1_authreq.py: using BVCI 21030 11:05:22.927767 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:22.938972 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:22.950149 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:22.961299 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:22.972484 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:22.983673 tst encryption: Using 1 x modem (candidates: 1) 11:05:23.098888 tst register_a5_1_authreq.py:8: start network... 11:05:23.307180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:23.786303 run create_hlr_db(pid=29595): Launched 11:05:23.915484 bus /sierra_2: Setting Powered False 11:05:24.976598 run create_hlr_db(pid=29595): Terminated: ok {rc=0} 11:05:25.407955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29597): Launched 11:05:25.717456 run osmo-hlr_10.42.42.2(pid=29598): Launched 11:05:25.836743 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:26.368777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29600): Launched 11:05:26.678089 run osmo-stp_10.42.42.5(pid=29601): Launched 11:05:26.795612 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:27.351962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29603): Launched 11:05:27.660697 run osmo-msc_10.42.42.6(pid=29604): Launched 11:05:27.833142 run osmo-stp_10.42.42.5(pid=29601): ERR: Terminated: ERROR {rc=1} [trial-2358↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29601)] 11:05:27.963275 run osmo-stp_10.42.42.5(pid=29601): stdout: | (launched: 2022-12-09_11:05:26.620633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:28.092847 run osmo-stp_10.42.42.5(pid=29601): stderr: | 20221209110526791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110526791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110526791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110526791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110526792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110526792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110526792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:28.221104 run osmo-stp_10.42.42.5(pid=29601): stdout: | (launched: 2022-12-09_11:05:26.620633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:28.343149 run osmo-stp_10.42.42.5(pid=29601): stderr: | 20221209110526791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110526791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110526791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110526791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110526792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110526792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110526792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:28.489331 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29601): Process ended prematurely: osmo-stp_10.42.42.5(pid=29601) [trial-2358↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29601)] [trial-2358↪encryption↪register_a5_1_authreq.py:8] 11:05:28.498404 tst register_a5_1_authreq.py:8: Test FAILED (6.1 sec) 11:05:28.525089 run osmo-hlr_10.42.42.2(pid=29598): ERR: Terminated: ERROR {rc=237} [trial-2358↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29598)] 11:05:28.572654 run osmo-hlr_10.42.42.2(pid=29598): stdout: | (launched: 2022-12-09_11:05:25.660324) 11:05:28.622327 run osmo-hlr_10.42.42.2(pid=29598): stderr: | 20221209110525838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110525838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110525838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110525838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110525838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110525838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110525853 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110525864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110525864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110525864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:28.691277 run osmo-msc_10.42.42.6(pid=29604): ERR: Terminated: ERROR {rc=2} [trial-2358↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29604)] 11:05:28.738937 run osmo-msc_10.42.42.6(pid=29604): stdout: | (launched: 2022-12-09_11:05:27.603759) 11:05:28.788173 run osmo-msc_10.42.42.6(pid=29604): stderr: | 20221209110527874 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110527874 DLGLOBAL DEBUG validating counter group 0x7f6c61002c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110527874 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110527874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110527874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110527874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110527876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110527876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110527877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110527877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:28.837979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29597): Terminating (SIGTERM) 11:05:28.877443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29600): Terminating (SIGTERM) 11:05:28.917387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29603): Terminating (SIGTERM) 11:05:28.957510 --- ParallelTerminationStrategy: PID 29597 died... 11:05:28.976567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29597): Terminated: ok {rc=0} 11:05:29.020385 --- ParallelTerminationStrategy: PID 29600 died... 11:05:29.039085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29600): Terminated: ok {rc=0} 11:05:29.082549 --- ParallelTerminationStrategy: PID 29603 died... 11:05:29.101234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29603): Terminated: ok {rc=0} 11:05:29.186099 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2358 encryption register_a5_3_authreq.py ---------------------------------------------- 11:05:30.336552 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:30.347769 tst encryption: Using 1 x bts (candidates: 1) 11:05:30.383406 tst register_a5_3_authreq.py: using LAC 21030 11:05:30.504679 tst register_a5_3_authreq.py: using RAC 120 11:05:30.626272 tst register_a5_3_authreq.py: using CellId 21030 11:05:30.749724 tst register_a5_3_authreq.py: using BVCI 21031 11:05:30.871544 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:30.886931 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:30.902516 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:30.913806 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:30.924583 tst encryption: Using 1 x ip_address (candidates: 6) 11:05:30.935618 tst encryption: Using 1 x modem (candidates: 1) 11:05:31.071829 tst register_a5_3_authreq.py:8: start network... 11:05:31.300710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:31.829240 run create_hlr_db(pid=29606): Launched 11:05:31.978939 bus /sierra_2: Setting Powered False 11:05:33.043829 run create_hlr_db(pid=29606): Terminated: ok {rc=0} 11:05:33.485087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29608): Launched 11:05:33.793682 run osmo-hlr_10.42.42.2(pid=29609): Launched 11:05:33.911667 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:34.457693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29611): Launched 11:05:34.767612 run osmo-stp_10.42.42.5(pid=29612): Launched 11:05:34.885266 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:35.442244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29614): Launched 11:05:35.751292 run osmo-msc_10.42.42.6(pid=29615): Launched 11:05:35.923984 run osmo-stp_10.42.42.5(pid=29612): ERR: Terminated: ERROR {rc=1} [trial-2358↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29612)] 11:05:36.054954 run osmo-stp_10.42.42.5(pid=29612): stdout: | (launched: 2022-12-09_11:05:34.710579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:36.185195 run osmo-stp_10.42.42.5(pid=29612): stderr: | 20221209110534879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110534879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110534879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110534880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110534880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110534880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110534880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:36.313638 run osmo-stp_10.42.42.5(pid=29612): stdout: | (launched: 2022-12-09_11:05:34.710579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:36.436040 run osmo-stp_10.42.42.5(pid=29612): stderr: | 20221209110534879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110534879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110534879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110534880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110534880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110534880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110534880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:36.582776 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29612): Process ended prematurely: osmo-stp_10.42.42.5(pid=29612) [trial-2358↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29612)] [trial-2358↪encryption↪register_a5_3_authreq.py:8] 11:05:36.592007 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 11:05:36.618402 run osmo-hlr_10.42.42.2(pid=29609): ERR: Terminated: ERROR {rc=237} [trial-2358↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29609)] 11:05:36.666695 run osmo-hlr_10.42.42.2(pid=29609): stdout: | (launched: 2022-12-09_11:05:33.737105) 11:05:36.716424 run osmo-hlr_10.42.42.2(pid=29609): stderr: | 20221209110533909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110533909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110533909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110533909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110533909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110533909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110533921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110533929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110533929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110533930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:36.785615 run osmo-msc_10.42.42.6(pid=29615): ERR: Terminated: ERROR {rc=2} [trial-2358↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29615)] 11:05:36.833395 run osmo-msc_10.42.42.6(pid=29615): stdout: | (launched: 2022-12-09_11:05:35.693844) 11:05:36.882709 run osmo-msc_10.42.42.6(pid=29615): stderr: | 20221209110535966 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110535966 DLGLOBAL DEBUG validating counter group 0x7f70100d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110535966 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110535966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110535966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110535966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110535968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110535968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110535969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110535969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:36.932608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29608): Terminating (SIGTERM) 11:05:36.972308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29611): Terminating (SIGTERM) 11:05:37.012390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29614): Terminating (SIGTERM) 11:05:37.052560 --- ParallelTerminationStrategy: PID 29608 died... 11:05:37.073002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29608): Terminated: ok {rc=0} 11:05:37.117684 --- ParallelTerminationStrategy: PID 29611 died... 11:05:37.136290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29611): Terminated: ok {rc=0} 11:05:37.180544 --- ParallelTerminationStrategy: PID 29614 died... 11:05:37.199404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29614): Terminated: ok {rc=0} 11:05:37.285304 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 11:05:38.493101 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:38.498654 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 11:05:38.517111 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 11:05:38.544701 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 11:05:38.572576 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 11:05:38.591392 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 11:05:38.619765 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 11:05:39.128069 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 11:05:39.133753 tst handover.py:11: TEST_CONFIG: {} 11:05:39.339426 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:05:39.355332 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:05:39.378334 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:05:39.431685 tst handover.py: using MSISDN 7180 11:05:39.546126 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7180', subscriber_id=0} 11:05:39.653621 run srsepc_10.42.42.118: Starting srsepc 11:05:41.506069 run rm-remote-dir(pid=29620): Launched 11:05:41.642637 bus /sierra_2: Setting Powered False 11:05:42.712096 run rm-remote-dir(pid=29620): Terminated: ok {rc=0} 11:05:43.188698 run mk-remote-dir(pid=29621): Launched 11:05:44.381120 run mk-remote-dir(pid=29621): Terminated: ok {rc=0} 11:05:44.689725 run scp-inst-to-remote(pid=29622): Launched 11:05:46.882905 run scp-inst-to-remote(pid=29622): Terminated: ok {rc=0} 11:05:47.231321 run rm-remote-dir(pid=29624): Launched 11:05:48.466928 run rm-remote-dir(pid=29624): Terminated: ok {rc=0} 11:05:48.804556 run mk-remote-dir(pid=29625): Launched 11:05:49.986515 run mk-remote-dir(pid=29625): Terminated: ok {rc=0} 11:05:50.275522 run scp-cfg-to-remote(pid=29626): Launched 11:05:51.455130 run scp-cfg-to-remote(pid=29626): Terminated: ok {rc=0} 11:05:51.740795 run scp-db-to-remote(pid=29628): Launched 11:05:52.919902 run scp-db-to-remote(pid=29628): Terminated: ok {rc=0} 11:05:53.051929 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:05:53.362395 run patchelf(pid=29630): Launched 11:05:54.542100 run patchelf(pid=29630): Terminated: ok {rc=0} 11:05:54.673966 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:05:54.984504 run setcap-netadm(pid=29631): Launched 11:05:56.163314 run setcap-netadm(pid=29631): Terminated: ok {rc=0} 11:05:56.489347 run srsepc(pid=29632): Launched 11:05:56.606054 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:05:57.727475 run rm-remote-dir(pid=29633): Launched 11:05:57.906616 run srsepc(pid=29632): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29632)] 11:05:58.042785 run srsepc(pid=29632): stdout: | (launched: 2022-12-09_11:05:56.432051) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:05:58.178278 run srsepc(pid=29632): stderr: | (launched: 2022-12-09_11:05:56.478084) | Connection to 10.42.42.116 closed. 11:05:58.313451 run srsepc(pid=29632): stdout: | (launched: 2022-12-09_11:05:56.432051) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:05:58.443094 run srsepc(pid=29632): stderr: | (launched: 2022-12-09_11:05:56.478084) | Connection to 10.42.42.116 closed. 11:05:58.596421 run rm-remote-dir(pid=29633): Terminating (SIGINT) 11:05:58.774720 run rm-remote-dir(pid=29633): Terminated: ok {rc=0} 11:05:58.903412 tst handover.py:37: ERR: Error: srsepc(pid=29632): Process ended prematurely: srsepc(pid=29632) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29632)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 11:05:58.913636 tst handover.py:37: Test FAILED (19.8 sec) 11:05:58.992039 run scp-back-log(pid=29634): Launched 11:06:00.070446 run scp-back-log(pid=29634): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29634)] 11:06:00.131772 run scp-back-log(pid=29634): stdout: | (launched: 2022-12-09_11:05:58.960528) 11:06:00.194620 run scp-back-log(pid=29634): stderr: | (launched: 2022-12-09_11:05:58.980407) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:06:00.265872 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29634): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29634)]') ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 11:06:00.311963 tst iperf3_bidir.py:13: Number of physical ue: 1 11:06:00.517809 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:06:00.559252 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 11:06:00.763217 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:06:00.778891 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:06:00.810548 tst iperf3_bidir.py: using MSISDN 7181 11:06:00.936782 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7181', subscriber_id=0} 11:06:01.051758 run srsepc_10.42.42.118: Starting srsepc 11:06:01.752197 run rm-remote-dir(pid=29636): Launched 11:06:03.017063 run rm-remote-dir(pid=29636): Terminated: ok {rc=0} 11:06:03.378499 run mk-remote-dir(pid=29637): Launched 11:06:04.570197 run mk-remote-dir(pid=29637): Terminated: ok {rc=0} 11:06:04.877636 run scp-inst-to-remote(pid=29638): Launched 11:06:07.069624 run scp-inst-to-remote(pid=29638): Terminated: ok {rc=0} 11:06:07.427857 run rm-remote-dir(pid=29640): Launched 11:06:08.619554 run rm-remote-dir(pid=29640): Terminated: ok {rc=0} 11:06:08.979663 run mk-remote-dir(pid=29641): Launched 11:06:10.174373 run mk-remote-dir(pid=29641): Terminated: ok {rc=0} 11:06:10.481926 run scp-cfg-to-remote(pid=29642): Launched 11:06:11.671976 run scp-cfg-to-remote(pid=29642): Terminated: ok {rc=0} 11:06:11.977409 run scp-db-to-remote(pid=29644): Launched 11:06:13.169747 run scp-db-to-remote(pid=29644): Terminated: ok {rc=0} 11:06:13.310650 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:06:13.642904 run patchelf(pid=29646): Launched 11:06:14.831781 run patchelf(pid=29646): Terminated: ok {rc=0} 11:06:14.972337 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:06:15.305223 run setcap-netadm(pid=29647): Launched 11:06:16.497608 run setcap-netadm(pid=29647): Terminated: ok {rc=0} 11:06:16.850463 run srsepc(pid=29648): Launched 11:06:17.046089 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:06:18.217834 run rm-remote-dir(pid=29649): Launched 11:06:18.398113 run srsepc(pid=29648): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29648)] 11:06:18.534510 run srsepc(pid=29648): stdout: | (launched: 2022-12-09_11:06:16.789866) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:06:18.670153 run srsepc(pid=29648): stderr: | (launched: 2022-12-09_11:06:16.839807) | Connection to 10.42.42.116 closed. 11:06:18.805900 run srsepc(pid=29648): stdout: | (launched: 2022-12-09_11:06:16.789866) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:06:18.935939 run srsepc(pid=29648): stderr: | (launched: 2022-12-09_11:06:16.839807) | Connection to 10.42.42.116 closed. 11:06:19.090219 run rm-remote-dir(pid=29649): Terminating (SIGINT) 11:06:19.268834 run rm-remote-dir(pid=29649): Terminated: ok {rc=0} 11:06:19.398122 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=29648): Process ended prematurely: srsepc(pid=29648) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29648)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 11:06:19.408188 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 11:06:19.485706 run scp-back-log(pid=29650): Launched 11:06:20.563900 run scp-back-log(pid=29650): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29650)] 11:06:20.624923 run scp-back-log(pid=29650): stdout: | (launched: 2022-12-09_11:06:19.454922) 11:06:20.687447 run scp-back-log(pid=29650): stderr: | (launched: 2022-12-09_11:06:19.474630) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:06:20.757629 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29650): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29650)]') ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 11:06:20.803581 tst iperf3_dl.py:13: Number of physical ue: 1 11:06:21.009236 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:06:21.053350 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 11:06:21.257649 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:06:21.273433 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:06:21.305724 tst iperf3_dl.py: using MSISDN 7182 11:06:21.419172 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7182', subscriber_id=0} 11:06:21.526621 run srsepc_10.42.42.118: Starting srsepc 11:06:22.159583 run rm-remote-dir(pid=29652): Launched 11:06:23.340864 run rm-remote-dir(pid=29652): Terminated: ok {rc=0} 11:06:23.678356 run mk-remote-dir(pid=29653): Launched 11:06:24.859494 run mk-remote-dir(pid=29653): Terminated: ok {rc=0} 11:06:25.146500 run scp-inst-to-remote(pid=29654): Launched 11:06:27.329980 run scp-inst-to-remote(pid=29654): Terminated: ok {rc=0} 11:06:27.690059 run rm-remote-dir(pid=29656): Launched 11:06:28.882522 run rm-remote-dir(pid=29656): Terminated: ok {rc=0} 11:06:29.243572 run mk-remote-dir(pid=29657): Launched 11:06:30.437636 run mk-remote-dir(pid=29657): Terminated: ok {rc=0} 11:06:30.745716 run scp-cfg-to-remote(pid=29658): Launched 11:06:31.968601 run scp-cfg-to-remote(pid=29658): Terminated: ok {rc=0} 11:06:32.260713 run scp-db-to-remote(pid=29660): Launched 11:06:33.440575 run scp-db-to-remote(pid=29660): Terminated: ok {rc=0} 11:06:33.571980 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:06:33.882386 run patchelf(pid=29662): Launched 11:06:35.061457 run patchelf(pid=29662): Terminated: ok {rc=0} 11:06:35.193373 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:06:35.503922 run setcap-netadm(pid=29663): Launched 11:06:36.682557 run setcap-netadm(pid=29663): Terminated: ok {rc=0} 11:06:37.007784 run srsepc(pid=29664): Launched 11:06:37.124561 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:06:38.247515 run rm-remote-dir(pid=29665): Launched 11:06:38.434351 run srsepc(pid=29664): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29664)] 11:06:38.571649 run srsepc(pid=29664): stdout: | (launched: 2022-12-09_11:06:36.950619) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:06:38.707536 run srsepc(pid=29664): stderr: | (launched: 2022-12-09_11:06:36.996557) | Connection to 10.42.42.116 closed. 11:06:38.843045 run srsepc(pid=29664): stdout: | (launched: 2022-12-09_11:06:36.950619) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:06:38.972658 run srsepc(pid=29664): stderr: | (launched: 2022-12-09_11:06:36.996557) | Connection to 10.42.42.116 closed. 11:06:39.127126 run rm-remote-dir(pid=29665): Terminating (SIGINT) 11:06:39.305232 run rm-remote-dir(pid=29665): Terminated: ok {rc=0} 11:06:39.434337 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=29664): Process ended prematurely: srsepc(pid=29664) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29664)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 11:06:39.444637 tst iperf3_dl.py:42: Test FAILED (18.6 sec) 11:06:39.523130 run scp-back-log(pid=29666): Launched 11:06:40.600152 run scp-back-log(pid=29666): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29666)] 11:06:40.661134 run scp-back-log(pid=29666): stdout: | (launched: 2022-12-09_11:06:39.491488) 11:06:40.723542 run scp-back-log(pid=29666): stderr: | (launched: 2022-12-09_11:06:39.511267) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:06:40.794327 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29666): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29666)]') ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 11:06:40.840026 tst iperf3_ul.py:13: Number of physical ue: 1 11:06:41.045491 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:06:41.087531 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 11:06:41.309426 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:06:41.326160 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:06:41.359586 tst iperf3_ul.py: using MSISDN 7183 11:06:41.472599 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7183', subscriber_id=0} 11:06:41.580582 run srsepc_10.42.42.118: Starting srsepc 11:06:42.215459 run rm-remote-dir(pid=29668): Launched 11:06:43.397242 run rm-remote-dir(pid=29668): Terminated: ok {rc=0} 11:06:43.735249 run mk-remote-dir(pid=29669): Launched 11:06:44.916456 run mk-remote-dir(pid=29669): Terminated: ok {rc=0} 11:06:45.204660 run scp-inst-to-remote(pid=29670): Launched 11:06:47.386261 run scp-inst-to-remote(pid=29670): Terminated: ok {rc=0} 11:06:47.723944 run rm-remote-dir(pid=29672): Launched 11:06:48.906178 run rm-remote-dir(pid=29672): Terminated: ok {rc=0} 11:06:49.243997 run mk-remote-dir(pid=29673): Launched 11:06:50.425073 run mk-remote-dir(pid=29673): Terminated: ok {rc=0} 11:06:50.713713 run scp-cfg-to-remote(pid=29674): Launched 11:06:51.898311 run scp-cfg-to-remote(pid=29674): Terminated: ok {rc=0} 11:06:52.205901 run scp-db-to-remote(pid=29676): Launched 11:06:53.397653 run scp-db-to-remote(pid=29676): Terminated: ok {rc=0} 11:06:53.539647 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:06:53.873634 run patchelf(pid=29678): Launched 11:06:55.063792 run patchelf(pid=29678): Terminated: ok {rc=0} 11:06:55.206335 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:06:55.539597 run setcap-netadm(pid=29679): Launched 11:06:56.731697 run setcap-netadm(pid=29679): Terminated: ok {rc=0} 11:06:57.080458 run srsepc(pid=29680): Launched 11:06:57.204164 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:06:58.397802 run rm-remote-dir(pid=29681): Launched 11:06:58.587802 run srsepc(pid=29680): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29680)] 11:06:58.732516 run srsepc(pid=29680): stdout: | (launched: 2022-12-09_11:06:57.019735) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:06:58.877329 run srsepc(pid=29680): stderr: | (launched: 2022-12-09_11:06:57.069160) | Connection to 10.42.42.116 closed. 11:06:59.022534 run srsepc(pid=29680): stdout: | (launched: 2022-12-09_11:06:57.019735) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:06:59.162909 run srsepc(pid=29680): stderr: | (launched: 2022-12-09_11:06:57.069160) | Connection to 10.42.42.116 closed. 11:06:59.328819 run rm-remote-dir(pid=29681): Terminating (SIGINT) 11:06:59.519843 run rm-remote-dir(pid=29681): Terminated: ok {rc=0} 11:06:59.657743 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=29680): Process ended prematurely: srsepc(pid=29680) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29680)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 11:06:59.668716 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 11:06:59.752173 run scp-back-log(pid=29682): Launched 11:07:00.844377 run scp-back-log(pid=29682): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29682)] 11:07:00.919622 run scp-back-log(pid=29682): stdout: | (launched: 2022-12-09_11:06:59.718798) 11:07:00.996418 run scp-back-log(pid=29682): stderr: | (launched: 2022-12-09_11:06:59.739787) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:07:01.093814 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29682): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29682)]') ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 11:07:01.160659 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:07:01.186134 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:07:01.218305 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:07:01.277353 tst ping.py: using MSISDN 7184 11:07:01.431983 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7184', subscriber_id=0} 11:07:01.580002 run srsepc_10.42.42.118: Starting srsepc 11:07:02.291180 run rm-remote-dir(pid=29684): Launched 11:07:03.473603 run rm-remote-dir(pid=29684): Terminated: ok {rc=0} 11:07:03.810807 run mk-remote-dir(pid=29685): Launched 11:07:04.992014 run mk-remote-dir(pid=29685): Terminated: ok {rc=0} 11:07:05.279491 run scp-inst-to-remote(pid=29686): Launched 11:07:07.460162 run scp-inst-to-remote(pid=29686): Terminated: ok {rc=0} 11:07:07.794770 run rm-remote-dir(pid=29688): Launched 11:07:08.975985 run rm-remote-dir(pid=29688): Terminated: ok {rc=0} 11:07:09.313512 run mk-remote-dir(pid=29689): Launched 11:07:10.495386 run mk-remote-dir(pid=29689): Terminated: ok {rc=0} 11:07:10.783842 run scp-cfg-to-remote(pid=29690): Launched 11:07:11.963110 run scp-cfg-to-remote(pid=29690): Terminated: ok {rc=0} 11:07:12.248434 run scp-db-to-remote(pid=29692): Launched 11:07:13.427147 run scp-db-to-remote(pid=29692): Terminated: ok {rc=0} 11:07:13.558809 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:07:13.869334 run patchelf(pid=29694): Launched 11:07:15.048018 run patchelf(pid=29694): Terminated: ok {rc=0} 11:07:15.179468 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:07:15.489676 run setcap-netadm(pid=29695): Launched 11:07:16.684199 run setcap-netadm(pid=29695): Terminated: ok {rc=0} 11:07:17.053822 run srsepc(pid=29696): Launched 11:07:17.224258 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:07:18.415026 run rm-remote-dir(pid=29697): Launched 11:07:18.606658 run srsepc(pid=29696): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29696)] 11:07:18.750837 run srsepc(pid=29696): stdout: | (launched: 2022-12-09_11:07:16.995623) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:07:18.896379 run srsepc(pid=29696): stderr: | (launched: 2022-12-09_11:07:17.042277) | Connection to 10.42.42.116 closed. 11:07:19.041405 run srsepc(pid=29696): stdout: | (launched: 2022-12-09_11:07:16.995623) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:07:19.181303 run srsepc(pid=29696): stderr: | (launched: 2022-12-09_11:07:17.042277) | Connection to 10.42.42.116 closed. 11:07:19.346491 run rm-remote-dir(pid=29697): Terminating (SIGINT) 11:07:19.537163 run rm-remote-dir(pid=29697): Terminated: ok {rc=0} 11:07:19.675347 tst ping.py:16: ERR: Error: srsepc(pid=29696): Process ended prematurely: srsepc(pid=29696) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29696)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 11:07:19.686342 tst ping.py:16: Test FAILED (18.5 sec) 11:07:19.769100 run scp-back-log(pid=29698): Launched 11:07:20.850544 run scp-back-log(pid=29698): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29698)] 11:07:20.915702 run scp-back-log(pid=29698): stdout: | (launched: 2022-12-09_11:07:19.736227) 11:07:20.982247 run scp-back-log(pid=29698): stderr: | (launched: 2022-12-09_11:07:19.757180) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:07:21.057170 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29698): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29698)]') ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 11:07:21.106504 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:07:21.123716 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:07:21.147850 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:07:21.203993 tst rrc_idle_mo_ping.py: using MSISDN 7185 11:07:21.327581 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7185', subscriber_id=0} 11:07:21.443319 run srsepc_10.42.42.118: Starting srsepc 11:07:22.120723 run rm-remote-dir(pid=29700): Launched 11:07:23.314034 run rm-remote-dir(pid=29700): Terminated: ok {rc=0} 11:07:23.675805 run mk-remote-dir(pid=29701): Launched 11:07:24.870252 run mk-remote-dir(pid=29701): Terminated: ok {rc=0} 11:07:25.179667 run scp-inst-to-remote(pid=29702): Launched 11:07:27.372168 run scp-inst-to-remote(pid=29702): Terminated: ok {rc=0} 11:07:27.731669 run rm-remote-dir(pid=29704): Launched 11:07:28.924399 run rm-remote-dir(pid=29704): Terminated: ok {rc=0} 11:07:29.286478 run mk-remote-dir(pid=29705): Launched 11:07:30.478943 run mk-remote-dir(pid=29705): Terminated: ok {rc=0} 11:07:30.786849 run scp-cfg-to-remote(pid=29706): Launched 11:07:32.010355 run scp-cfg-to-remote(pid=29706): Terminated: ok {rc=0} 11:07:32.303093 run scp-db-to-remote(pid=29708): Launched 11:07:33.495787 run scp-db-to-remote(pid=29708): Terminated: ok {rc=0} 11:07:33.636912 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:07:33.970387 run patchelf(pid=29710): Launched 11:07:35.161993 run patchelf(pid=29710): Terminated: ok {rc=0} 11:07:35.303567 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:07:35.637276 run setcap-netadm(pid=29711): Launched 11:07:36.827082 run setcap-netadm(pid=29711): Terminated: ok {rc=0} 11:07:37.178344 run srsepc(pid=29715): Launched 11:07:37.302294 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:07:38.497405 run rm-remote-dir(pid=29716): Launched 11:07:38.689106 run srsepc(pid=29715): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29715)] 11:07:38.834232 run srsepc(pid=29715): stdout: | (launched: 2022-12-09_11:07:37.116880) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:07:38.980356 run srsepc(pid=29715): stderr: | (launched: 2022-12-09_11:07:37.166281) | Connection to 10.42.42.116 closed. 11:07:39.127481 run srsepc(pid=29715): stdout: | (launched: 2022-12-09_11:07:37.116880) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:07:39.267881 run srsepc(pid=29715): stderr: | (launched: 2022-12-09_11:07:37.166281) | Connection to 10.42.42.116 closed. 11:07:39.434395 run rm-remote-dir(pid=29716): Terminating (SIGINT) 11:07:39.626227 run rm-remote-dir(pid=29716): Terminated: ok {rc=0} 11:07:39.764854 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=29715): Process ended prematurely: srsepc(pid=29715) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29715)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 11:07:39.775849 tst rrc_idle_mo_ping.py:16: Test FAILED (18.7 sec) 11:07:39.858792 run scp-back-log(pid=29717): Launched 11:07:40.940122 run scp-back-log(pid=29717): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29717)] 11:07:41.005294 run scp-back-log(pid=29717): stdout: | (launched: 2022-12-09_11:07:39.825858) 11:07:41.072025 run scp-back-log(pid=29717): stderr: | (launched: 2022-12-09_11:07:39.846847) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:07:41.146799 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29717): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29717)]') ---------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 11:07:41.195500 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:07:41.212789 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:07:41.237134 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:07:41.287507 tst rrc_idle_mt_ping.py: using MSISDN 7186 11:07:41.403569 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7186', subscriber_id=0} 11:07:41.511170 run srsepc_10.42.42.118: Starting srsepc 11:07:42.144914 run rm-remote-dir(pid=29719): Launched 11:07:43.327360 run rm-remote-dir(pid=29719): Terminated: ok {rc=0} 11:07:43.665301 run mk-remote-dir(pid=29720): Launched 11:07:44.846961 run mk-remote-dir(pid=29720): Terminated: ok {rc=0} 11:07:45.136462 run scp-inst-to-remote(pid=29721): Launched 11:07:47.334682 run scp-inst-to-remote(pid=29721): Terminated: ok {rc=0} 11:07:47.718707 run rm-remote-dir(pid=29723): Launched 11:07:48.911389 run rm-remote-dir(pid=29723): Terminated: ok {rc=0} 11:07:49.274361 run mk-remote-dir(pid=29724): Launched 11:07:50.466337 run mk-remote-dir(pid=29724): Terminated: ok {rc=0} 11:07:50.774975 run scp-cfg-to-remote(pid=29725): Launched 11:07:51.965992 run scp-cfg-to-remote(pid=29725): Terminated: ok {rc=0} 11:07:52.272668 run scp-db-to-remote(pid=29727): Launched 11:07:53.464834 run scp-db-to-remote(pid=29727): Terminated: ok {rc=0} 11:07:53.605672 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:07:53.939597 run patchelf(pid=29729): Launched 11:07:55.131949 run patchelf(pid=29729): Terminated: ok {rc=0} 11:07:55.274040 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:07:55.609438 run setcap-netadm(pid=29730): Launched 11:07:56.799412 run setcap-netadm(pid=29730): Terminated: ok {rc=0} 11:07:57.149496 run srsepc(pid=29731): Launched 11:07:57.273507 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:07:58.471337 run rm-remote-dir(pid=29732): Launched 11:07:58.660636 run srsepc(pid=29731): ERR: Terminated: ERROR {rc=127} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29731)] 11:07:58.804839 run srsepc(pid=29731): stdout: | (launched: 2022-12-09_11:07:57.087486) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:07:58.949337 run srsepc(pid=29731): stderr: | (launched: 2022-12-09_11:07:57.137908) | Connection to 10.42.42.116 closed. 11:07:59.093833 run srsepc(pid=29731): stdout: | (launched: 2022-12-09_11:07:57.087486) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:07:59.234010 run srsepc(pid=29731): stderr: | (launched: 2022-12-09_11:07:57.137908) | Connection to 10.42.42.116 closed. 11:07:59.399265 run rm-remote-dir(pid=29732): Terminating (SIGINT) 11:07:59.590155 run rm-remote-dir(pid=29732): Terminated: ok {rc=0} 11:07:59.728063 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=29731): Process ended prematurely: srsepc(pid=29731) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29731)] [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 11:07:59.739095 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 11:07:59.822512 run scp-back-log(pid=29733): Launched 11:08:00.905467 run scp-back-log(pid=29733): ERR: Terminated: ERROR {rc=1} [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29733)] 11:08:00.973876 run scp-back-log(pid=29733): stdout: | (launched: 2022-12-09_11:07:59.789375) 11:08:01.043609 run scp-back-log(pid=29733): stderr: | (launched: 2022-12-09_11:07:59.810507) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:08:01.122067 tst srsepc_10.42.42.118: Error('scp-back-log(pid=29733): launch_sync(): local process exited with status 1 [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=29733)]') --------------------------------------------------------------------- trial-2358 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 11:08:01.262149 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:01.271382 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 11:08:01.331121 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 11:08:01.366468 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 11:08:01.435275 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 11:08:01.493195 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 11:08:01.530480 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 11:08:02.121489 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 11:08:02.132788 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:08:02.154831 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:08:02.214871 tst handover.py: using LAC 21031 11:08:02.377144 tst handover.py: using RAC 121 11:08:02.512286 tst handover.py: using CellId 21031 11:08:02.685272 tst handover.py: using BVCI 21032 11:08:02.827211 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:08:02.867497 tst handover.py: using LAC 21032 11:08:03.024859 tst handover.py: using RAC 122 11:08:03.176376 tst handover.py: using CellId 21032 11:08:03.336534 tst handover.py: using BVCI 21033 11:08:03.481409 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:08:03.494703 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:08:03.511823 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:08:03.527943 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:08:03.545726 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:08:03.560317 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:08:03.722884 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:08:03.862843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:04.444567 run create_hlr_db(pid=30007): Launched 11:08:05.668500 run create_hlr_db(pid=30007): Terminated: ok {rc=0} 11:08:06.022002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Launched 11:08:06.373572 run osmo-hlr_10.42.42.2(pid=30011): Launched 11:08:06.620880 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:07.268421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30014): Launched 11:08:07.614610 run osmo-stp_10.42.42.5(pid=30015): Launched 11:08:07.905363 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:08.484871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30017): Launched 11:08:08.808401 run osmo-msc_10.42.42.6(pid=30018): Launched 11:08:09.154189 run osmo-stp_10.42.42.5(pid=30015): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30015)] 11:08:09.464192 run osmo-stp_10.42.42.5(pid=30015): stdout: | (launched: 2022-12-09_11:08:07.552071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:09.754583 run osmo-stp_10.42.42.5(pid=30015): stderr: | 20221209110807884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110807884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110807884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110807893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110807893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110807894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110807894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:09.895822 run osmo-stp_10.42.42.5(pid=30015): stdout: | (launched: 2022-12-09_11:08:07.552071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:10.019759 run osmo-stp_10.42.42.5(pid=30015): stderr: | 20221209110807884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110807884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110807884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110807893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110807893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110807894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110807894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:10.168898 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30015): Process ended prematurely: osmo-stp_10.42.42.5(pid=30015) [trial-2358↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30015)] [trial-2358↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 11:08:10.178522 tst handover.py:18: Test FAILED (8.0 sec) 11:08:10.206955 run osmo-hlr_10.42.42.2(pid=30011): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30011)] 11:08:10.257239 run osmo-hlr_10.42.42.2(pid=30011): stdout: | (launched: 2022-12-09_11:08:06.306302) 11:08:10.309099 run osmo-hlr_10.42.42.2(pid=30011): stderr: | 20221209110806609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110806609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110806609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110806609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110806609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110806610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110806627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110806640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110806640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110806640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:10.381393 run osmo-msc_10.42.42.6(pid=30018): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30018)] 11:08:10.431782 run osmo-msc_10.42.42.6(pid=30018): stdout: | (launched: 2022-12-09_11:08:08.750681) 11:08:10.483765 run osmo-msc_10.42.42.6(pid=30018): stderr: | 20221209110809366 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110809366 DLGLOBAL DEBUG validating counter group 0x7f448ddccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110809366 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110809366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110809367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110809367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110809368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110809373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110809373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110809373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:10.536150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Terminating (SIGTERM) 11:08:10.578955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30014): Terminating (SIGTERM) 11:08:10.623825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30017): Terminating (SIGTERM) 11:08:10.668575 --- ParallelTerminationStrategy: PID 30009 died... 11:08:10.689129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Terminated: ok {rc=0} 11:08:10.737375 --- ParallelTerminationStrategy: PID 30014 died... 11:08:10.757520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30014): Terminated: ok {rc=0} 11:08:10.803728 --- ParallelTerminationStrategy: PID 30017 died... 11:08:10.823806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30017): Terminated: ok {rc=0} 11:08:10.914711 bus /sierra_3: Setting Powered False 11:08:12.015432 bus /sierra_3: Setting Powered False 11:08:13.131546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 11:08:14.389819 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:14.396275 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:08:14.441542 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:08:14.471765 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:08:14.524034 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:08:14.568597 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:08:14.597071 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:08:15.148797 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 11:08:15.155937 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:08:15.169375 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:08:15.211940 tst handover.py: using LAC 21033 11:08:15.344736 tst handover.py: using RAC 123 11:08:15.477359 tst handover.py: using CellId 21033 11:08:15.610286 tst handover.py: using BVCI 21034 11:08:15.735279 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:08:15.772045 tst handover.py: using LAC 21034 11:08:15.925887 tst handover.py: using RAC 124 11:08:16.068378 tst handover.py: using CellId 21034 11:08:16.216105 tst handover.py: using BVCI 21035 11:08:16.359957 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:08:16.375301 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:08:16.390469 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:08:16.406568 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:08:16.421321 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:08:16.436750 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:08:16.587005 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:08:16.742324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:17.341292 run create_hlr_db(pid=30023): Launched 11:08:17.560516 bus /sierra_2: Setting Powered False 11:08:18.624766 run create_hlr_db(pid=30023): Terminated: ok {rc=0} 11:08:19.073611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30025): Launched 11:08:19.426899 run osmo-hlr_10.42.42.2(pid=30026): Launched 11:08:19.684243 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:20.336384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30028): Launched 11:08:20.688517 run osmo-stp_10.42.42.5(pid=30029): Launched 11:08:20.946741 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:21.608684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30031): Launched 11:08:21.963504 run osmo-msc_10.42.42.6(pid=30032): Launched 11:08:22.344679 run osmo-stp_10.42.42.5(pid=30029): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30029)] 11:08:22.655008 run osmo-stp_10.42.42.5(pid=30029): stdout: | (launched: 2022-12-09_11:08:20.626830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:22.806097 run osmo-stp_10.42.42.5(pid=30029): stderr: | 20221209110820925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110820925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110820926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110820926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110820926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110820927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110820927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:22.948923 run osmo-stp_10.42.42.5(pid=30029): stdout: | (launched: 2022-12-09_11:08:20.626830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:23.085759 run osmo-stp_10.42.42.5(pid=30029): stderr: | 20221209110820925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110820925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110820926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110820926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110820926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110820927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110820927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:23.249187 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30029): Process ended prematurely: osmo-stp_10.42.42.5(pid=30029) [trial-2358↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30029)] [trial-2358↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 11:08:23.260342 tst handover.py:18: Test FAILED (8.1 sec) 11:08:23.289493 run osmo-hlr_10.42.42.2(pid=30026): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30026)] 11:08:23.342335 run osmo-hlr_10.42.42.2(pid=30026): stdout: | (launched: 2022-12-09_11:08:19.365963) 11:08:23.397804 run osmo-hlr_10.42.42.2(pid=30026): stderr: | 20221209110819677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110819677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110819677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110819677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110819677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110819677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110819693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110819706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110819706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110819706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:23.473336 run osmo-msc_10.42.42.6(pid=30032): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30032)] 11:08:23.525882 run osmo-msc_10.42.42.6(pid=30032): stdout: | (launched: 2022-12-09_11:08:21.899408) 11:08:23.581241 run osmo-msc_10.42.42.6(pid=30032): stderr: | 20221209110822417 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110822418 DLGLOBAL DEBUG validating counter group 0x7f3114575c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110822418 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110822418 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110822418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110822418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110822420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110822420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110822421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110822421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:23.635948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30025): Terminating (SIGTERM) 11:08:23.680372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30028): Terminating (SIGTERM) 11:08:23.726271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30031): Terminating (SIGTERM) 11:08:23.773371 --- ParallelTerminationStrategy: PID 30025 died... 11:08:23.794352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30025): Terminated: ok {rc=0} 11:08:23.843979 --- ParallelTerminationStrategy: PID 30028 died... 11:08:23.865450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30028): Terminated: ok {rc=0} 11:08:23.914656 --- ParallelTerminationStrategy: PID 30031 died... 11:08:23.935267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30031): Terminated: ok {rc=0} 11:08:24.029478 bus /sierra_3: Setting Powered False 11:08:25.135563 bus /sierra_3: Setting Powered False 11:08:26.257392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 11:08:27.500293 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:27.505693 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:08:27.559531 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:08:27.586096 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:08:27.639045 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:08:27.691763 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:08:27.718020 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:08:28.266936 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 11:08:28.272185 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:28.283019 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:08:28.320716 tst handover.py: using LAC 21035 11:08:28.441987 tst handover.py: using RAC 125 11:08:28.563457 tst handover.py: using CellId 21035 11:08:28.686906 tst handover.py: using BVCI 21036 11:08:28.801601 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:08:28.853436 tst handover.py: using LAC 21036 11:08:28.974748 tst handover.py: using RAC 126 11:08:29.095958 tst handover.py: using CellId 21036 11:08:29.215972 tst handover.py: using BVCI 21037 11:08:29.328621 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:29.339473 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:29.350153 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:29.361154 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:29.372077 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:29.382930 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:08:29.504464 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:08:29.621806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:30.074415 run create_hlr_db(pid=30038): Launched 11:08:30.193902 bus /sierra_2: Setting Powered False 11:08:31.275917 run create_hlr_db(pid=30038): Terminated: ok {rc=0} 11:08:31.754905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30040): Launched 11:08:32.108437 run osmo-hlr_10.42.42.2(pid=30041): Launched 11:08:32.290994 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:32.808018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30043): Launched 11:08:33.116247 run osmo-stp_10.42.42.5(pid=30044): Launched 11:08:33.234466 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:33.765408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30046): Launched 11:08:34.076648 run osmo-msc_10.42.42.6(pid=30047): Launched 11:08:34.251244 run osmo-stp_10.42.42.5(pid=30044): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30044)] 11:08:34.381944 run osmo-stp_10.42.42.5(pid=30044): stdout: | (launched: 2022-12-09_11:08:33.059141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:34.512652 run osmo-stp_10.42.42.5(pid=30044): stderr: | 20221209110833229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110833229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110833229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110833230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110833230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110833230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110833231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:34.640723 run osmo-stp_10.42.42.5(pid=30044): stdout: | (launched: 2022-12-09_11:08:33.059141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:34.763164 run osmo-stp_10.42.42.5(pid=30044): stderr: | 20221209110833229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110833229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110833229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110833230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110833230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110833230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110833231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:34.909691 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30044): Process ended prematurely: osmo-stp_10.42.42.5(pid=30044) [trial-2358↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30044)] [trial-2358↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 11:08:34.917948 tst handover.py:18: Test FAILED (6.6 sec) 11:08:34.944777 run osmo-hlr_10.42.42.2(pid=30041): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30041)] 11:08:34.993224 run osmo-hlr_10.42.42.2(pid=30041): stdout: | (launched: 2022-12-09_11:08:32.050289) 11:08:35.043487 run osmo-hlr_10.42.42.2(pid=30041): stderr: | 20221209110832306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110832306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110832306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110832306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110832307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110832307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110832319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110832327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110832327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110832327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:35.113415 run osmo-msc_10.42.42.6(pid=30047): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30047)] 11:08:35.161897 run osmo-msc_10.42.42.6(pid=30047): stdout: | (launched: 2022-12-09_11:08:34.019236) 11:08:35.211844 run osmo-msc_10.42.42.6(pid=30047): stderr: | 20221209110834289 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110834289 DLGLOBAL DEBUG validating counter group 0x7f5d1f7a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110834289 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110834289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110834290 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110834290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110834291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110834292 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110834292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110834292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:35.262378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30040): Terminating (SIGTERM) 11:08:35.302829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30043): Terminating (SIGTERM) 11:08:35.343210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30046): Terminating (SIGTERM) 11:08:35.383684 --- ParallelTerminationStrategy: PID 30040 died... 11:08:35.402860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30040): Terminated: ok {rc=0} 11:08:35.447746 --- ParallelTerminationStrategy: PID 30043 died... 11:08:35.466462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30043): Terminated: ok {rc=0} 11:08:35.510919 --- ParallelTerminationStrategy: PID 30046 died... 11:08:35.529604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30046): Terminated: ok {rc=0} 11:08:35.616418 bus /sierra_3: Setting Powered False 11:08:36.716567 bus /sierra_3: Setting Powered False 11:08:37.833006 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:08:39.089352 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:39.094664 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:08:39.144207 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:08:39.170338 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:08:39.222850 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:08:39.272580 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:08:39.299134 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:08:39.848867 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:08:39.854165 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:39.865134 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:08:39.902903 tst handover.py: using LAC 21037 11:08:40.023632 tst handover.py: using RAC 127 11:08:40.144046 tst handover.py: using CellId 21037 11:08:40.266250 tst handover.py: using BVCI 21038 11:08:40.380576 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:08:40.426351 tst handover.py: using LAC 21038 11:08:40.553276 tst handover.py: using RAC 128 11:08:40.672790 tst handover.py: using CellId 21038 11:08:40.792127 tst handover.py: using BVCI 21039 11:08:40.904127 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:40.915215 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:40.926075 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:40.937192 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:40.948460 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:40.959408 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:08:41.078671 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:08:41.195697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:41.647380 run create_hlr_db(pid=30053): Launched 11:08:41.764889 bus /sierra_2: Setting Powered False 11:08:42.826246 run create_hlr_db(pid=30053): Terminated: ok {rc=0} 11:08:43.248623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30055): Launched 11:08:43.581768 run osmo-hlr_10.42.42.2(pid=30056): Launched 11:08:43.708327 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:44.247129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30058): Launched 11:08:44.577436 run osmo-stp_10.42.42.5(pid=30059): Launched 11:08:44.704536 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:45.281084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30061): Launched 11:08:45.613741 run osmo-msc_10.42.42.6(pid=30062): Launched 11:08:45.799017 run osmo-stp_10.42.42.5(pid=30059): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30059)] 11:08:46.080757 run osmo-stp_10.42.42.5(pid=30059): stdout: | (launched: 2022-12-09_11:08:44.516552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:46.287506 run osmo-stp_10.42.42.5(pid=30059): stderr: | 20221209110844709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110844710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110844710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110844710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110844711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110844711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110844711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:46.425205 run osmo-stp_10.42.42.5(pid=30059): stdout: | (launched: 2022-12-09_11:08:44.516552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:46.557994 run osmo-stp_10.42.42.5(pid=30059): stderr: | 20221209110844709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110844710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110844710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110844710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110844711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110844711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110844711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:46.713682 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30059): Process ended prematurely: osmo-stp_10.42.42.5(pid=30059) [trial-2358↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30059)] [trial-2358↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 11:08:46.723480 tst handover.py:18: Test FAILED (6.9 sec) 11:08:46.753859 run osmo-hlr_10.42.42.2(pid=30056): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30056)] 11:08:46.806857 run osmo-hlr_10.42.42.2(pid=30056): stdout: | (launched: 2022-12-09_11:08:43.520720) 11:08:46.860463 run osmo-hlr_10.42.42.2(pid=30056): stderr: | 20221209110843719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110843719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110843719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110843719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110843719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110843719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110843731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110843740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110843740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110843740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:46.935753 run osmo-msc_10.42.42.6(pid=30062): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30062)] 11:08:46.989302 run osmo-msc_10.42.42.6(pid=30062): stdout: | (launched: 2022-12-09_11:08:45.552503) 11:08:47.042661 run osmo-msc_10.42.42.6(pid=30062): stderr: | 20221209110845889 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110845893 DLGLOBAL DEBUG validating counter group 0x7f92745a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110845893 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110845893 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110845893 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110845894 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110845895 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110845896 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110845896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110845896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:47.096355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30055): Terminating (SIGTERM) 11:08:47.140522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30058): Terminating (SIGTERM) 11:08:47.186500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30061): Terminating (SIGTERM) 11:08:47.232039 --- ParallelTerminationStrategy: PID 30055 died... 11:08:47.252879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30055): Terminated: ok {rc=0} 11:08:47.298642 --- ParallelTerminationStrategy: PID 30058 died... 11:08:47.317808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30058): Terminated: ok {rc=0} 11:08:47.362795 --- ParallelTerminationStrategy: PID 30061 died... 11:08:47.381835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30061): Terminated: ok {rc=0} 11:08:47.468405 bus /sierra_3: Setting Powered False 11:08:48.568127 bus /sierra_3: Setting Powered False 11:08:49.685755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:08:50.947896 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:50.954454 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:08:51.009190 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:08:51.035632 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:08:51.086693 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:08:51.139615 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:08:51.165971 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:08:51.718035 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:08:51.723252 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:51.734274 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:08:51.771668 tst handover.py: using LAC 21039 11:08:51.892729 tst handover.py: using RAC 129 11:08:52.014035 tst handover.py: using CellId 21039 11:08:52.137887 tst handover.py: using BVCI 21040 11:08:52.250383 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:08:52.299040 tst handover.py: using LAC 21040 11:08:52.421788 tst handover.py: using RAC 130 11:08:52.544699 tst handover.py: using CellId 21040 11:08:52.677196 tst handover.py: using BVCI 21041 11:08:52.799110 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:52.810884 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:52.822409 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:52.834002 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:52.845517 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:52.857090 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:08:52.975124 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:08:53.092625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:53.544668 run create_hlr_db(pid=30068): Launched 11:08:53.663955 bus /sierra_2: Setting Powered False 11:08:54.725786 run create_hlr_db(pid=30068): Terminated: ok {rc=0} 11:08:55.130025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30070): Launched 11:08:55.438990 run osmo-hlr_10.42.42.2(pid=30071): Launched 11:08:55.556565 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:56.073636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30073): Launched 11:08:56.384239 run osmo-stp_10.42.42.5(pid=30074): Launched 11:08:56.502743 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:57.033720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30076): Launched 11:08:57.343938 run osmo-msc_10.42.42.6(pid=30077): Launched 11:08:57.516326 run osmo-stp_10.42.42.5(pid=30074): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30074)] 11:08:57.646345 run osmo-stp_10.42.42.5(pid=30074): stdout: | (launched: 2022-12-09_11:08:56.326795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:57.775654 run osmo-stp_10.42.42.5(pid=30074): stderr: | 20221209110856498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110856498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110856498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110856498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110856499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110856499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110856499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:57.903657 run osmo-stp_10.42.42.5(pid=30074): stdout: | (launched: 2022-12-09_11:08:56.326795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:58.025665 run osmo-stp_10.42.42.5(pid=30074): stderr: | 20221209110856498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110856498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110856498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110856498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110856499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110856499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110856499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:58.171762 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30074): Process ended prematurely: osmo-stp_10.42.42.5(pid=30074) [trial-2358↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30074)] [trial-2358↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 11:08:58.180322 tst handover.py:18: Test FAILED (6.5 sec) 11:08:58.207165 run osmo-hlr_10.42.42.2(pid=30071): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30071)] 11:08:58.255629 run osmo-hlr_10.42.42.2(pid=30071): stdout: | (launched: 2022-12-09_11:08:55.381835) 11:08:58.306385 run osmo-hlr_10.42.42.2(pid=30071): stderr: | 20221209110855558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110855558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110855558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110855558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110855558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110855559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110855574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110855584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110855585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110855585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:58.376386 run osmo-msc_10.42.42.6(pid=30077): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30077)] 11:08:58.424713 run osmo-msc_10.42.42.6(pid=30077): stdout: | (launched: 2022-12-09_11:08:57.286529) 11:08:58.474643 run osmo-msc_10.42.42.6(pid=30077): stderr: | 20221209110857560 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110857560 DLGLOBAL DEBUG validating counter group 0x7fcc82c71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110857560 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110857560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110857560 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110857561 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110857562 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110857563 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110857563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110857563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:58.525305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30070): Terminating (SIGTERM) 11:08:58.565794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30073): Terminating (SIGTERM) 11:08:58.606178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30076): Terminating (SIGTERM) 11:08:58.646827 --- ParallelTerminationStrategy: PID 30070 died... 11:08:58.666033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30070): Terminated: ok {rc=0} 11:08:58.710916 --- ParallelTerminationStrategy: PID 30073 died... 11:08:58.729556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30073): Terminated: ok {rc=0} 11:08:58.774748 --- ParallelTerminationStrategy: PID 30076 died... 11:08:58.793453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30076): Terminated: ok {rc=0} 11:08:58.880375 bus /sierra_3: Setting Powered False 11:08:59.980064 bus /sierra_3: Setting Powered False 11:09:01.097655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 11:09:02.388723 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:02.394810 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:09:02.437060 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:09:02.464233 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:09:02.516607 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:09:02.559038 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:09:02.586116 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:09:03.137846 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 11:09:03.143169 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:03.154502 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:09:03.192480 tst handover.py: using LAC 21041 11:09:03.321381 tst handover.py: using RAC 131 11:09:03.449731 tst handover.py: using CellId 21041 11:09:03.581102 tst handover.py: using BVCI 21042 11:09:03.703266 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:09:03.737707 tst handover.py: using LAC 21042 11:09:03.858013 tst handover.py: using RAC 132 11:09:03.977669 tst handover.py: using CellId 21042 11:09:04.097291 tst handover.py: using BVCI 21043 11:09:04.210253 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:04.221372 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:04.231863 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:04.242861 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:04.254025 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:04.264883 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:09:04.384751 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:09:04.503832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:04.956577 run create_hlr_db(pid=30082): Launched 11:09:05.073629 bus /sierra_2: Setting Powered False 11:09:06.134291 run create_hlr_db(pid=30082): Terminated: ok {rc=0} 11:09:06.537411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Launched 11:09:06.847474 run osmo-hlr_10.42.42.2(pid=30085): Launched 11:09:06.965262 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:07.484556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Launched 11:09:07.792868 run osmo-stp_10.42.42.5(pid=30088): Launched 11:09:07.911886 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:08.443042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Launched 11:09:08.751469 run osmo-msc_10.42.42.6(pid=30091): Launched 11:09:08.926752 run osmo-stp_10.42.42.5(pid=30088): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] 11:09:09.056672 run osmo-stp_10.42.42.5(pid=30088): stdout: | (launched: 2022-12-09_11:09:07.735810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:09.186995 run osmo-stp_10.42.42.5(pid=30088): stderr: | 20221209110907907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110907907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110907907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110907907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110907908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110907908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110907908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:09.314904 run osmo-stp_10.42.42.5(pid=30088): stdout: | (launched: 2022-12-09_11:09:07.735810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:09.436805 run osmo-stp_10.42.42.5(pid=30088): stderr: | 20221209110907907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110907907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110907907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110907907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110907908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110907908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110907908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:09.583294 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30088): Process ended prematurely: osmo-stp_10.42.42.5(pid=30088) [trial-2358↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] [trial-2358↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 11:09:09.591872 tst handover.py:18: Test FAILED (6.4 sec) 11:09:09.618858 run osmo-hlr_10.42.42.2(pid=30085): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30085)] 11:09:09.667344 run osmo-hlr_10.42.42.2(pid=30085): stdout: | (launched: 2022-12-09_11:09:06.790278) 11:09:09.717965 run osmo-hlr_10.42.42.2(pid=30085): stderr: | 20221209110906968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110906968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110906968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110906968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110906968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110906968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110906979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110906992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110906992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110906992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:09.787833 run osmo-msc_10.42.42.6(pid=30091): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30091)] 11:09:09.836234 run osmo-msc_10.42.42.6(pid=30091): stdout: | (launched: 2022-12-09_11:09:08.694412) 11:09:09.886161 run osmo-msc_10.42.42.6(pid=30091): stderr: | 20221209110908967 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110908967 DLGLOBAL DEBUG validating counter group 0x7f648f863c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110908968 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110908968 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110908968 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110908968 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110908970 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110908970 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110908970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110908970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:09.936658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Terminating (SIGTERM) 11:09:09.977120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Terminating (SIGTERM) 11:09:10.017441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Terminating (SIGTERM) 11:09:10.057817 --- ParallelTerminationStrategy: PID 30084 died... 11:09:10.077073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Terminated: ok {rc=0} 11:09:10.121455 --- ParallelTerminationStrategy: PID 30087 died... 11:09:10.140126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Terminated: ok {rc=0} 11:09:10.184557 --- ParallelTerminationStrategy: PID 30090 died... 11:09:10.203286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Terminated: ok {rc=0} 11:09:10.289480 bus /sierra_3: Setting Powered False 11:09:11.390862 bus /sierra_3: Setting Powered False 11:09:12.507842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 11:09:13.755045 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:13.760701 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:09:13.814492 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:09:13.840758 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:09:13.892166 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:09:13.944599 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:09:13.970936 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:09:14.524447 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 11:09:14.529914 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:14.542831 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:09:14.581381 tst handover.py: using LAC 21043 11:09:14.700712 tst handover.py: using RAC 133 11:09:14.820734 tst handover.py: using CellId 21043 11:09:14.940085 tst handover.py: using BVCI 21044 11:09:15.052224 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:09:15.101547 tst handover.py: using LAC 21044 11:09:15.222506 tst handover.py: using RAC 134 11:09:15.342927 tst handover.py: using CellId 21044 11:09:15.461918 tst handover.py: using BVCI 21045 11:09:15.575944 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:15.586776 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:15.597653 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:15.608556 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:15.619478 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:15.630346 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:09:15.746681 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:09:15.878354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:16.339064 run create_hlr_db(pid=30096): Launched 11:09:16.498372 bus /sierra_2: Setting Powered False 11:09:17.560926 run create_hlr_db(pid=30096): Terminated: ok {rc=0} 11:09:17.965727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Launched 11:09:18.279058 run osmo-hlr_10.42.42.2(pid=30099): Launched 11:09:18.395347 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:18.890820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Launched 11:09:19.195069 run osmo-stp_10.42.42.5(pid=30102): Launched 11:09:19.313461 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:19.838194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30104): Launched 11:09:20.143036 run osmo-msc_10.42.42.6(pid=30105): Launched 11:09:20.313252 run osmo-stp_10.42.42.5(pid=30102): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] 11:09:20.441507 run osmo-stp_10.42.42.5(pid=30102): stdout: | (launched: 2022-12-09_11:09:19.138221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:20.569792 run osmo-stp_10.42.42.5(pid=30102): stderr: | 20221209110919306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110919306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110919306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110919307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110919307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110919307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110919307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:20.696556 run osmo-stp_10.42.42.5(pid=30102): stdout: | (launched: 2022-12-09_11:09:19.138221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:20.816851 run osmo-stp_10.42.42.5(pid=30102): stderr: | 20221209110919306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110919306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110919306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110919307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110919307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110919307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110919307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:20.961134 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30102): Process ended prematurely: osmo-stp_10.42.42.5(pid=30102) [trial-2358↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] [trial-2358↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 11:09:20.969474 tst handover.py:18: Test FAILED (6.4 sec) 11:09:20.996207 run osmo-hlr_10.42.42.2(pid=30099): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30099)] 11:09:21.044258 run osmo-hlr_10.42.42.2(pid=30099): stdout: | (launched: 2022-12-09_11:09:18.218214) 11:09:21.093960 run osmo-hlr_10.42.42.2(pid=30099): stderr: | 20221209110918397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110918398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110918398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110918398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110918398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110918398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110918410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110918421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110918421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110918421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:21.163077 run osmo-msc_10.42.42.6(pid=30105): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30105)] 11:09:21.210931 run osmo-msc_10.42.42.6(pid=30105): stdout: | (launched: 2022-12-09_11:09:20.086543) 11:09:21.260486 run osmo-msc_10.42.42.6(pid=30105): stderr: | 20221209110920358 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110920358 DLGLOBAL DEBUG validating counter group 0x7f5e137cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110920359 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110920359 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110920359 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110920359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110920361 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110920361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110920361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110920361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:21.310528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Terminating (SIGTERM) 11:09:21.351009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Terminating (SIGTERM) 11:09:21.390699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30104): Terminating (SIGTERM) 11:09:21.430844 --- ParallelTerminationStrategy: PID 30098 died... 11:09:21.449794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Terminated: ok {rc=0} 11:09:21.493884 --- ParallelTerminationStrategy: PID 30101 died... 11:09:21.512370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Terminated: ok {rc=0} 11:09:21.556258 --- ParallelTerminationStrategy: PID 30104 died... 11:09:21.574863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30104): Terminated: ok {rc=0} 11:09:21.658180 bus /sierra_3: Setting Powered False 11:09:22.756258 bus /sierra_3: Setting Powered False 11:09:23.873983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 11:09:25.137927 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:25.143521 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:09:25.197299 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:09:25.224428 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:09:25.278132 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:09:25.332271 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:09:25.359663 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:09:25.905812 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 11:09:25.911234 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:25.922234 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:09:25.962145 tst handover.py: using LAC 21045 11:09:26.091671 tst handover.py: using RAC 135 11:09:26.226601 tst handover.py: using CellId 21045 11:09:26.354364 tst handover.py: using BVCI 21046 11:09:26.474717 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:09:26.522467 tst handover.py: using LAC 21046 11:09:26.650783 tst handover.py: using RAC 136 11:09:26.777463 tst handover.py: using CellId 21046 11:09:26.905827 tst handover.py: using BVCI 21047 11:09:27.024458 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:27.035887 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:27.047022 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:27.058163 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:27.069437 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:27.080563 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:09:27.196623 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:09:27.315903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:27.795642 run create_hlr_db(pid=30110): Launched 11:09:27.930585 bus /sierra_2: Setting Powered False 11:09:28.994407 run create_hlr_db(pid=30110): Terminated: ok {rc=0} 11:09:29.396097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30112): Launched 11:09:29.700915 run osmo-hlr_10.42.42.2(pid=30113): Launched 11:09:29.818304 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:30.329748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30115): Launched 11:09:30.632549 run osmo-stp_10.42.42.5(pid=30116): Launched 11:09:30.749508 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:31.353748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30118): Launched 11:09:31.699390 run osmo-msc_10.42.42.6(pid=30119): Launched 11:09:32.015340 run osmo-stp_10.42.42.5(pid=30116): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30116)] 11:09:32.286868 run osmo-stp_10.42.42.5(pid=30116): stdout: | (launched: 2022-12-09_11:09:30.576167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:32.477299 run osmo-stp_10.42.42.5(pid=30116): stderr: | 20221209110930743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110930743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110930743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110930744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110930744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110930744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110930744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:32.614714 run osmo-stp_10.42.42.5(pid=30116): stdout: | (launched: 2022-12-09_11:09:30.576167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:32.744460 run osmo-stp_10.42.42.5(pid=30116): stderr: | 20221209110930743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110930743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110930743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110930744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110930744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110930744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110930744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:32.899987 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30116): Process ended prematurely: osmo-stp_10.42.42.5(pid=30116) [trial-2358↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30116)] [trial-2358↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 11:09:32.909120 tst handover.py:18: Test FAILED (7.0 sec) 11:09:32.936802 run osmo-hlr_10.42.42.2(pid=30113): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30113)] 11:09:32.987497 run osmo-hlr_10.42.42.2(pid=30113): stdout: | (launched: 2022-12-09_11:09:29.644569) 11:09:33.039814 run osmo-hlr_10.42.42.2(pid=30113): stderr: | 20221209110929817 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110929817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110929817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110929817 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110929818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110929818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110929830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110929840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110929841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110929841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:33.112504 run osmo-msc_10.42.42.6(pid=30119): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30119)] 11:09:33.163135 run osmo-msc_10.42.42.6(pid=30119): stdout: | (launched: 2022-12-09_11:09:31.635386) 11:09:33.215242 run osmo-msc_10.42.42.6(pid=30119): stderr: | 20221209110932319 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110932319 DLGLOBAL DEBUG validating counter group 0x7fe8e0552c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110932319 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110932319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110932320 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110932320 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110932322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110932322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110932322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110932322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:33.267805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30112): Terminating (SIGTERM) 11:09:33.310035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30115): Terminating (SIGTERM) 11:09:33.352251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30118): Terminating (SIGTERM) 11:09:33.394626 --- ParallelTerminationStrategy: PID 30112 died... 11:09:33.415021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30112): Terminated: ok {rc=0} 11:09:33.461868 --- ParallelTerminationStrategy: PID 30115 died... 11:09:33.481673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30115): Terminated: ok {rc=0} 11:09:33.528566 --- ParallelTerminationStrategy: PID 30118 died... 11:09:33.548360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30118): Terminated: ok {rc=0} 11:09:33.637980 bus /sierra_3: Setting Powered False 11:09:34.739568 bus /sierra_3: Setting Powered False 11:09:35.858428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 11:09:37.118937 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:37.123905 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:09:37.160373 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:09:37.186523 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:09:37.237826 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:09:37.274211 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:09:37.300385 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:09:37.849643 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 11:09:37.856105 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:09:37.867513 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:09:37.903360 tst handover.py: using LAC 21047 11:09:38.033187 tst handover.py: using RAC 137 11:09:38.161511 tst handover.py: using CellId 21047 11:09:38.288479 tst handover.py: using BVCI 21048 11:09:38.406834 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:09:38.446192 tst handover.py: using LAC 21048 11:09:38.573601 tst handover.py: using RAC 138 11:09:38.693025 tst handover.py: using CellId 21048 11:09:38.820498 tst handover.py: using BVCI 21049 11:09:38.939196 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:09:38.950545 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:09:38.961874 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:09:38.973179 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:09:38.984366 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:09:38.995515 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:09:39.112022 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:09:39.233468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:39.712468 run create_hlr_db(pid=30125): Launched 11:09:39.847269 bus /sierra_2: Setting Powered False 11:09:40.911591 run create_hlr_db(pid=30125): Terminated: ok {rc=0} 11:09:41.321127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30127): Launched 11:09:41.626806 run osmo-hlr_10.42.42.2(pid=30128): Launched 11:09:41.744222 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:42.259955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30130): Launched 11:09:42.565270 run osmo-stp_10.42.42.5(pid=30131): Launched 11:09:42.681903 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:43.207688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30133): Launched 11:09:43.512908 run osmo-msc_10.42.42.6(pid=30134): Launched 11:09:43.684113 run osmo-stp_10.42.42.5(pid=30131): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30131)] 11:09:43.813063 run osmo-stp_10.42.42.5(pid=30131): stdout: | (launched: 2022-12-09_11:09:42.508034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:43.941110 run osmo-stp_10.42.42.5(pid=30131): stderr: | 20221209110942675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110942676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110942676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110942676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110942677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110942677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110942677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:44.068897 run osmo-stp_10.42.42.5(pid=30131): stdout: | (launched: 2022-12-09_11:09:42.508034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:44.190076 run osmo-stp_10.42.42.5(pid=30131): stderr: | 20221209110942675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110942676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110942676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110942676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110942677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110942677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110942677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:44.335063 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30131): Process ended prematurely: osmo-stp_10.42.42.5(pid=30131) [trial-2358↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30131)] [trial-2358↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 11:09:44.343475 tst handover.py:18: Test FAILED (6.5 sec) 11:09:44.370095 run osmo-hlr_10.42.42.2(pid=30128): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30128)] 11:09:44.418338 run osmo-hlr_10.42.42.2(pid=30128): stdout: | (launched: 2022-12-09_11:09:41.570835) 11:09:44.468067 run osmo-hlr_10.42.42.2(pid=30128): stderr: | 20221209110941742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110941743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110941743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110941743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110941743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110941743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110941755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110941764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110941764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110941764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:44.536918 run osmo-msc_10.42.42.6(pid=30134): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30134)] 11:09:44.585131 run osmo-msc_10.42.42.6(pid=30134): stdout: | (launched: 2022-12-09_11:09:43.456571) 11:09:44.634577 run osmo-msc_10.42.42.6(pid=30134): stderr: | 20221209110943726 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110943726 DLGLOBAL DEBUG validating counter group 0x7f4ef78bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110943726 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110943726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110943726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110943727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110943728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110943729 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110943729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110943729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:44.684444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30127): Terminating (SIGTERM) 11:09:44.724248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30130): Terminating (SIGTERM) 11:09:44.763903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30133): Terminating (SIGTERM) 11:09:44.803820 --- ParallelTerminationStrategy: PID 30127 died... 11:09:44.822937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30127): Terminated: ok {rc=0} 11:09:44.867284 --- ParallelTerminationStrategy: PID 30130 died... 11:09:44.885833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30130): Terminated: ok {rc=0} 11:09:44.929952 --- ParallelTerminationStrategy: PID 30133 died... 11:09:44.948399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30133): Terminated: ok {rc=0} 11:09:45.034135 bus /sierra_3: Setting Powered False 11:09:46.133523 bus /sierra_3: Setting Powered False 11:09:47.251263 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 11:09:48.493761 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:48.499570 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:09:48.550681 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:09:48.577845 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:09:48.630260 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:09:48.681398 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:09:48.708397 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:09:49.259719 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 11:09:49.265074 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:09:49.276210 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:09:49.311340 tst handover.py: using LAC 21049 11:09:49.440693 tst handover.py: using RAC 139 11:09:49.570946 tst handover.py: using CellId 21049 11:09:49.698295 tst handover.py: using BVCI 21050 11:09:49.816441 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:09:49.864142 tst handover.py: using LAC 21050 11:09:49.991572 tst handover.py: using RAC 140 11:09:50.117687 tst handover.py: using CellId 21050 11:09:50.244708 tst handover.py: using BVCI 21051 11:09:50.363068 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:09:50.374328 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:09:50.385285 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:09:50.396250 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:09:50.407340 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:09:50.418446 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:09:50.536096 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:09:50.655118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:51.133949 run create_hlr_db(pid=30139): Launched 11:09:51.269219 bus /sierra_2: Setting Powered False 11:09:52.333644 run create_hlr_db(pid=30139): Terminated: ok {rc=0} 11:09:52.760476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30141): Launched 11:09:53.088382 run osmo-hlr_10.42.42.2(pid=30142): Launched 11:09:53.213618 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:53.745890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30144): Launched 11:09:54.072603 run osmo-stp_10.42.42.5(pid=30145): Launched 11:09:54.198260 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:54.759608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30147): Launched 11:09:55.086839 run osmo-msc_10.42.42.6(pid=30148): Launched 11:09:55.270766 run osmo-stp_10.42.42.5(pid=30145): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30145)] 11:09:55.407684 run osmo-stp_10.42.42.5(pid=30145): stdout: | (launched: 2022-12-09_11:09:54.012146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:55.545101 run osmo-stp_10.42.42.5(pid=30145): stderr: | 20221209110954201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110954201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110954201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110954201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110954202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110954202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110954202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:55.681147 run osmo-stp_10.42.42.5(pid=30145): stdout: | (launched: 2022-12-09_11:09:54.012146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:55.810156 run osmo-stp_10.42.42.5(pid=30145): stderr: | 20221209110954201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209110954201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209110954201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209110954201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209110954202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209110954202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209110954202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:55.964454 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30145): Process ended prematurely: osmo-stp_10.42.42.5(pid=30145) [trial-2358↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30145)] [trial-2358↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 11:09:55.973518 tst handover.py:18: Test FAILED (6.7 sec) 11:09:56.001256 run osmo-hlr_10.42.42.2(pid=30142): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30142)] 11:09:56.051429 run osmo-hlr_10.42.42.2(pid=30142): stdout: | (launched: 2022-12-09_11:09:53.028247) 11:09:56.103805 run osmo-hlr_10.42.42.2(pid=30142): stderr: | 20221209110953226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209110953226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209110953226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209110953226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209110953226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209110953226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209110953241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209110953250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209110953250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209110953250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:56.176619 run osmo-msc_10.42.42.6(pid=30148): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30148)] 11:09:56.226769 run osmo-msc_10.42.42.6(pid=30148): stdout: | (launched: 2022-12-09_11:09:55.027278) 11:09:56.278530 run osmo-msc_10.42.42.6(pid=30148): stderr: | 20221209110955346 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209110955346 DLGLOBAL DEBUG validating counter group 0x7f669021fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209110955346 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209110955346 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209110955346 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209110955346 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209110955348 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209110955348 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209110955349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209110955349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:56.330790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30141): Terminating (SIGTERM) 11:09:56.372174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30144): Terminating (SIGTERM) 11:09:56.413702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30147): Terminating (SIGTERM) 11:09:56.455583 --- ParallelTerminationStrategy: PID 30141 died... 11:09:56.475189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30141): Terminated: ok {rc=0} 11:09:56.521124 --- ParallelTerminationStrategy: PID 30144 died... 11:09:56.540421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30144): Terminated: ok {rc=0} 11:09:56.586139 --- ParallelTerminationStrategy: PID 30147 died... 11:09:56.605452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30147): Terminated: ok {rc=0} 11:09:56.693114 bus /sierra_3: Setting Powered False 11:09:57.793535 bus /sierra_3: Setting Powered False 11:09:58.911414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:10:00.164879 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:00.170480 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:10:00.217104 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:10:00.243544 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:10:00.294915 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:10:00.341268 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:10:00.367489 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:10:00.933479 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:10:00.939274 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:00.954932 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:10:00.995527 tst handover.py: using LAC 21051 11:10:01.118745 tst handover.py: using RAC 141 11:10:01.250254 tst handover.py: using CellId 21051 11:10:01.415790 tst handover.py: using BVCI 21052 11:10:01.567623 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:10:01.614586 tst handover.py: using LAC 21052 11:10:01.737279 tst handover.py: using RAC 142 11:10:01.860275 tst handover.py: using CellId 21052 11:10:02.034120 tst handover.py: using BVCI 21053 11:10:02.152735 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:02.164884 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:02.176603 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:02.189299 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:02.203258 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:02.216101 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:10:02.335219 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:10:02.455526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:02.902770 run create_hlr_db(pid=30156): Launched 11:10:03.031913 bus /sierra_2: Setting Powered False 11:10:04.095663 run create_hlr_db(pid=30156): Terminated: ok {rc=0} 11:10:04.522475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Launched 11:10:04.852853 run osmo-hlr_10.42.42.2(pid=30159): Launched 11:10:04.977462 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:05.510941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Launched 11:10:05.839445 run osmo-stp_10.42.42.5(pid=30162): Launched 11:10:05.965711 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:06.529670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30164): Launched 11:10:06.859176 run osmo-msc_10.42.42.6(pid=30165): Launched 11:10:07.041399 run osmo-stp_10.42.42.5(pid=30162): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] 11:10:07.179140 run osmo-stp_10.42.42.5(pid=30162): stdout: | (launched: 2022-12-09_11:10:05.779664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:07.317153 run osmo-stp_10.42.42.5(pid=30162): stderr: | 20221209111005967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111005967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111005968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111005968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111005968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111005969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111005969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:07.453722 run osmo-stp_10.42.42.5(pid=30162): stdout: | (launched: 2022-12-09_11:10:05.779664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:07.584530 run osmo-stp_10.42.42.5(pid=30162): stderr: | 20221209111005967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111005967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111005968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111005968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111005968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111005969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111005969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:07.740620 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30162): Process ended prematurely: osmo-stp_10.42.42.5(pid=30162) [trial-2358↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] [trial-2358↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 11:10:07.749919 tst handover.py:18: Test FAILED (6.8 sec) 11:10:07.778369 run osmo-hlr_10.42.42.2(pid=30159): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30159)] 11:10:07.829595 run osmo-hlr_10.42.42.2(pid=30159): stdout: | (launched: 2022-12-09_11:10:04.792376) 11:10:07.882531 run osmo-hlr_10.42.42.2(pid=30159): stderr: | 20221209111004987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111004987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111004987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111004987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111004987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111004987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111005001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111005010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111005010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111005010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:07.955860 run osmo-msc_10.42.42.6(pid=30165): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30165)] 11:10:08.006628 run osmo-msc_10.42.42.6(pid=30165): stdout: | (launched: 2022-12-09_11:10:06.799041) 11:10:08.059093 run osmo-msc_10.42.42.6(pid=30165): stderr: | 20221209111007122 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111007122 DLGLOBAL DEBUG validating counter group 0x7fe2a8516c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111007122 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111007122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111007122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111007122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111007124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111007124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111007125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111007125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:08.112311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Terminating (SIGTERM) 11:10:08.154750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Terminating (SIGTERM) 11:10:08.198144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30164): Terminating (SIGTERM) 11:10:08.241459 --- ParallelTerminationStrategy: PID 30158 died... 11:10:08.261798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Terminated: ok {rc=0} 11:10:08.308882 --- ParallelTerminationStrategy: PID 30161 died... 11:10:08.328775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Terminated: ok {rc=0} 11:10:08.375816 --- ParallelTerminationStrategy: PID 30164 died... 11:10:08.395669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30164): Terminated: ok {rc=0} 11:10:08.485147 bus /sierra_3: Setting Powered False 11:10:09.585789 bus /sierra_3: Setting Powered False 11:10:10.702415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:10:11.960710 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:11.967149 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:10:12.018548 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:10:12.044844 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:10:12.095586 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:10:12.145444 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:10:12.171532 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:10:12.723315 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:10:12.728402 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:12.739342 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:10:12.774575 tst handover.py: using LAC 21053 11:10:12.894830 tst handover.py: using RAC 143 11:10:13.016476 tst handover.py: using CellId 21053 11:10:13.136278 tst handover.py: using BVCI 21054 11:10:13.249373 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:10:13.297283 tst handover.py: using LAC 21054 11:10:13.416870 tst handover.py: using RAC 144 11:10:13.540455 tst handover.py: using CellId 21054 11:10:13.660849 tst handover.py: using BVCI 21055 11:10:13.772164 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:13.782993 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:13.793725 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:13.804633 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:13.815790 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:13.826747 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:10:13.945352 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:10:14.064157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:14.544152 run create_hlr_db(pid=30170): Launched 11:10:14.678014 bus /sierra_2: Setting Powered False 11:10:15.742616 run create_hlr_db(pid=30170): Terminated: ok {rc=0} 11:10:16.205750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30172): Launched 11:10:16.548190 run osmo-hlr_10.42.42.2(pid=30173): Launched 11:10:16.709494 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:17.439852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30175): Launched 11:10:17.744730 run osmo-stp_10.42.42.5(pid=30176): Launched 11:10:17.861825 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:18.387207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30178): Launched 11:10:18.692512 run osmo-msc_10.42.42.6(pid=30179): Launched 11:10:18.864147 run osmo-stp_10.42.42.5(pid=30176): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30176)] 11:10:18.992688 run osmo-stp_10.42.42.5(pid=30176): stdout: | (launched: 2022-12-09_11:10:17.688846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:19.121491 run osmo-stp_10.42.42.5(pid=30176): stderr: | 20221209111017858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111017858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111017858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111017858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111017859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111017859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111017859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:19.248420 run osmo-stp_10.42.42.5(pid=30176): stdout: | (launched: 2022-12-09_11:10:17.688846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:19.369514 run osmo-stp_10.42.42.5(pid=30176): stderr: | 20221209111017858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111017858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111017858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111017858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111017859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111017859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111017859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:19.514481 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30176): Process ended prematurely: osmo-stp_10.42.42.5(pid=30176) [trial-2358↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30176)] [trial-2358↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 11:10:19.522644 tst handover.py:18: Test FAILED (6.8 sec) 11:10:19.549361 run osmo-hlr_10.42.42.2(pid=30173): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30173)] 11:10:19.597726 run osmo-hlr_10.42.42.2(pid=30173): stdout: | (launched: 2022-12-09_11:10:16.486751) 11:10:19.647572 run osmo-hlr_10.42.42.2(pid=30173): stderr: | 20221209111016828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111016828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111016828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111016828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111016828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111016828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111016843 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111016862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111016862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111016863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:19.716854 run osmo-msc_10.42.42.6(pid=30179): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30179)] 11:10:19.765124 run osmo-msc_10.42.42.6(pid=30179): stdout: | (launched: 2022-12-09_11:10:18.636427) 11:10:19.815230 run osmo-msc_10.42.42.6(pid=30179): stderr: | 20221209111018906 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111018906 DLGLOBAL DEBUG validating counter group 0x7f1ac39b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111018906 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111018906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111018907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111018907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111018909 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111018909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111018909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111018909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:19.866657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30172): Terminating (SIGTERM) 11:10:19.906904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30175): Terminating (SIGTERM) 11:10:19.947033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30178): Terminating (SIGTERM) 11:10:19.987341 --- ParallelTerminationStrategy: PID 30172 died... 11:10:20.006517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30172): Terminated: ok {rc=0} 11:10:20.050998 --- ParallelTerminationStrategy: PID 30175 died... 11:10:20.069461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30175): Terminated: ok {rc=0} 11:10:20.114269 --- ParallelTerminationStrategy: PID 30178 died... 11:10:20.132832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30178): Terminated: ok {rc=0} 11:10:20.217500 bus /sierra_3: Setting Powered False 11:10:21.316726 bus /sierra_3: Setting Powered False 11:10:22.434894 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 11:10:23.696804 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:23.702512 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:10:23.741917 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:10:23.769373 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:10:23.820660 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:10:23.859733 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:10:23.886835 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:10:24.438647 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 11:10:24.444312 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:24.455622 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:10:24.490941 tst handover.py: using LAC 21055 11:10:24.621008 tst handover.py: using RAC 145 11:10:24.748777 tst handover.py: using CellId 21055 11:10:24.876878 tst handover.py: using BVCI 21056 11:10:24.995094 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:10:25.034230 tst handover.py: using LAC 21056 11:10:25.161802 tst handover.py: using RAC 146 11:10:25.282192 tst handover.py: using CellId 21056 11:10:25.402310 tst handover.py: using BVCI 21057 11:10:25.513435 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:25.524149 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:25.534810 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:25.546372 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:25.557787 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:25.569278 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:10:25.689957 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:10:25.808595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:26.287547 run create_hlr_db(pid=30184): Launched 11:10:26.422172 bus /sierra_2: Setting Powered False 11:10:27.482084 run create_hlr_db(pid=30184): Terminated: ok {rc=0} 11:10:27.881056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30186): Launched 11:10:28.185719 run osmo-hlr_10.42.42.2(pid=30187): Launched 11:10:28.304344 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:28.813487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30189): Launched 11:10:29.119156 run osmo-stp_10.42.42.5(pid=30190): Launched 11:10:29.236276 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:29.760660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30192): Launched 11:10:30.065012 run osmo-msc_10.42.42.6(pid=30193): Launched 11:10:30.236064 run osmo-stp_10.42.42.5(pid=30190): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30190)] 11:10:30.365215 run osmo-stp_10.42.42.5(pid=30190): stdout: | (launched: 2022-12-09_11:10:29.062743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:30.493871 run osmo-stp_10.42.42.5(pid=30190): stderr: | 20221209111029232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111029232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111029232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111029233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111029233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111029233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111029234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:30.620375 run osmo-stp_10.42.42.5(pid=30190): stdout: | (launched: 2022-12-09_11:10:29.062743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:30.741725 run osmo-stp_10.42.42.5(pid=30190): stderr: | 20221209111029232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111029232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111029232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111029233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111029233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111029233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111029234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:30.915703 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30190): Process ended prematurely: osmo-stp_10.42.42.5(pid=30190) [trial-2358↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30190)] [trial-2358↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 11:10:30.926867 tst handover.py:18: Test FAILED (6.5 sec) 11:10:30.957352 run osmo-hlr_10.42.42.2(pid=30187): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30187)] 11:10:31.012257 run osmo-hlr_10.42.42.2(pid=30187): stdout: | (launched: 2022-12-09_11:10:28.129216) 11:10:31.064420 run osmo-hlr_10.42.42.2(pid=30187): stderr: | 20221209111028302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111028302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111028302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111028302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111028302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111028302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111028319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111028328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111028329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111028329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:31.136519 run osmo-msc_10.42.42.6(pid=30193): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30193)] 11:10:31.187230 run osmo-msc_10.42.42.6(pid=30193): stdout: | (launched: 2022-12-09_11:10:30.008881) 11:10:31.239264 run osmo-msc_10.42.42.6(pid=30193): stderr: | 20221209111030277 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111030278 DLGLOBAL DEBUG validating counter group 0x7fa624d4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111030278 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111030278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111030278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111030278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111030280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111030280 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111030280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111030280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:31.291780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30186): Terminating (SIGTERM) 11:10:31.334389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30189): Terminating (SIGTERM) 11:10:31.376623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30192): Terminating (SIGTERM) 11:10:31.419390 --- ParallelTerminationStrategy: PID 30186 died... 11:10:31.439143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30186): Terminated: ok {rc=0} 11:10:31.487362 --- ParallelTerminationStrategy: PID 30189 died... 11:10:31.506973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30189): Terminated: ok {rc=0} 11:10:31.554575 --- ParallelTerminationStrategy: PID 30192 died... 11:10:31.574203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30192): Terminated: ok {rc=0} 11:10:31.662056 bus /sierra_3: Setting Powered False 11:10:32.761855 bus /sierra_3: Setting Powered False 11:10:33.877861 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 11:10:35.114106 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:35.119310 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:10:35.169198 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:10:35.195698 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:10:35.247232 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:10:35.298877 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:10:35.326150 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:10:35.880800 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 11:10:35.886749 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:35.898143 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:10:35.933742 tst handover.py: using LAC 21057 11:10:36.061423 tst handover.py: using RAC 147 11:10:36.180491 tst handover.py: using CellId 21057 11:10:36.299300 tst handover.py: using BVCI 21058 11:10:36.411195 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:10:36.462386 tst handover.py: using LAC 21058 11:10:36.582275 tst handover.py: using RAC 148 11:10:36.702289 tst handover.py: using CellId 21058 11:10:36.822459 tst handover.py: using BVCI 21059 11:10:36.934974 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:36.945702 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:36.956136 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:36.967068 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:36.978069 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:36.988775 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:10:37.106338 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:10:37.228362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:37.706393 run create_hlr_db(pid=30198): Launched 11:10:37.840812 bus /sierra_2: Setting Powered False 11:10:38.905080 run create_hlr_db(pid=30198): Terminated: ok {rc=0} 11:10:39.313822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30200): Launched 11:10:39.619407 run osmo-hlr_10.42.42.2(pid=30201): Launched 11:10:39.737229 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:40.251958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30203): Launched 11:10:40.556806 run osmo-stp_10.42.42.5(pid=30204): Launched 11:10:40.674553 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:41.199599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30206): Launched 11:10:41.504412 run osmo-msc_10.42.42.6(pid=30207): Launched 11:10:41.676498 run osmo-stp_10.42.42.5(pid=30204): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30204)] 11:10:41.805138 run osmo-stp_10.42.42.5(pid=30204): stdout: | (launched: 2022-12-09_11:10:40.500558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:41.933411 run osmo-stp_10.42.42.5(pid=30204): stderr: | 20221209111040670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111040670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111040671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111040671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111040671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111040672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111040672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:42.060670 run osmo-stp_10.42.42.5(pid=30204): stdout: | (launched: 2022-12-09_11:10:40.500558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:42.181750 run osmo-stp_10.42.42.5(pid=30204): stderr: | 20221209111040670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111040670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111040671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111040671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111040671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111040672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111040672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:42.326197 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30204): Process ended prematurely: osmo-stp_10.42.42.5(pid=30204) [trial-2358↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30204)] [trial-2358↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 11:10:42.334688 tst handover.py:18: Test FAILED (6.4 sec) 11:10:42.361336 run osmo-hlr_10.42.42.2(pid=30201): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30201)] 11:10:42.409533 run osmo-hlr_10.42.42.2(pid=30201): stdout: | (launched: 2022-12-09_11:10:39.563301) 11:10:42.459703 run osmo-hlr_10.42.42.2(pid=30201): stderr: | 20221209111039736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111039736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111039736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111039736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111039736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111039736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111039748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111039756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111039756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111039756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:42.528885 run osmo-msc_10.42.42.6(pid=30207): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30207)] 11:10:42.577121 run osmo-msc_10.42.42.6(pid=30207): stdout: | (launched: 2022-12-09_11:10:41.448287) 11:10:42.626653 run osmo-msc_10.42.42.6(pid=30207): stderr: | 20221209111041717 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111041718 DLGLOBAL DEBUG validating counter group 0x7f48a28dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111041718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111041718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111041718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111041718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111041720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111041720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111041720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111041721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:42.676363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30200): Terminating (SIGTERM) 11:10:42.716255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30203): Terminating (SIGTERM) 11:10:42.755973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30206): Terminating (SIGTERM) 11:10:42.796014 --- ParallelTerminationStrategy: PID 30200 died... 11:10:42.815157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30200): Terminated: ok {rc=0} 11:10:42.859441 --- ParallelTerminationStrategy: PID 30203 died... 11:10:42.878010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30203): Terminated: ok {rc=0} 11:10:42.921998 --- ParallelTerminationStrategy: PID 30206 died... 11:10:42.940547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30206): Terminated: ok {rc=0} 11:10:43.026725 bus /sierra_3: Setting Powered False 11:10:44.125551 bus /sierra_3: Setting Powered False 11:10:45.241631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 11:10:46.565890 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:46.571789 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:10:46.625264 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:10:46.655352 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:10:46.707376 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:10:46.761317 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:10:46.789657 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:10:47.334833 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 11:10:47.340551 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:47.351983 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:10:47.386928 tst handover.py: using LAC 21059 11:10:47.507953 tst handover.py: using RAC 149 11:10:47.630707 tst handover.py: using CellId 21059 11:10:47.752078 tst handover.py: using BVCI 21060 11:10:47.862807 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:10:47.910288 tst handover.py: using LAC 21060 11:10:48.029865 tst handover.py: using RAC 150 11:10:48.159983 tst handover.py: using CellId 21060 11:10:48.281670 tst handover.py: using BVCI 21061 11:10:48.401823 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:48.413591 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:48.424768 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:48.436757 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:48.448769 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:48.460511 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:10:48.579225 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:10:48.701462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:49.149852 run create_hlr_db(pid=30212): Launched 11:10:49.267873 bus /sierra_2: Setting Powered False 11:10:50.328166 run create_hlr_db(pid=30212): Terminated: ok {rc=0} 11:10:50.749496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30214): Launched 11:10:51.057711 run osmo-hlr_10.42.42.2(pid=30215): Launched 11:10:51.175071 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:51.678008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30217): Launched 11:10:51.982662 run osmo-stp_10.42.42.5(pid=30218): Launched 11:10:52.100150 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:52.624869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30220): Launched 11:10:52.930641 run osmo-msc_10.42.42.6(pid=30221): Launched 11:10:53.101531 run osmo-stp_10.42.42.5(pid=30218): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30218)] 11:10:53.230904 run osmo-stp_10.42.42.5(pid=30218): stdout: | (launched: 2022-12-09_11:10:51.926467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:53.359606 run osmo-stp_10.42.42.5(pid=30218): stderr: | 20221209111052094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111052094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111052094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111052095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111052095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111052095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111052095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:53.486603 run osmo-stp_10.42.42.5(pid=30218): stdout: | (launched: 2022-12-09_11:10:51.926467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:53.607744 run osmo-stp_10.42.42.5(pid=30218): stderr: | 20221209111052094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111052094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111052094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111052095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111052095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111052095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111052095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:53.752629 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30218): Process ended prematurely: osmo-stp_10.42.42.5(pid=30218) [trial-2358↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30218)] [trial-2358↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 11:10:53.761252 tst handover.py:18: Test FAILED (6.4 sec) 11:10:53.788527 run osmo-hlr_10.42.42.2(pid=30215): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30215)] 11:10:53.837265 run osmo-hlr_10.42.42.2(pid=30215): stdout: | (launched: 2022-12-09_11:10:51.001432) 11:10:53.887147 run osmo-hlr_10.42.42.2(pid=30215): stderr: | 20221209111051176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111051176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111051176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111051176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111051176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111051176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111051188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111051198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111051198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111051198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:53.956583 run osmo-msc_10.42.42.6(pid=30221): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30221)] 11:10:54.004707 run osmo-msc_10.42.42.6(pid=30221): stdout: | (launched: 2022-12-09_11:10:52.874390) 11:10:54.054669 run osmo-msc_10.42.42.6(pid=30221): stderr: | 20221209111053145 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111053145 DLGLOBAL DEBUG validating counter group 0x7fcd54ceac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111053145 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111053145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111053145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111053146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111053147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111053148 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111053148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111053148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:54.105138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30214): Terminating (SIGTERM) 11:10:54.145436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30217): Terminating (SIGTERM) 11:10:54.185362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30220): Terminating (SIGTERM) 11:10:54.225777 --- ParallelTerminationStrategy: PID 30214 died... 11:10:54.245558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30214): Terminated: ok {rc=0} 11:10:54.290938 --- ParallelTerminationStrategy: PID 30217 died... 11:10:54.309738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30217): Terminated: ok {rc=0} 11:10:54.354622 --- ParallelTerminationStrategy: PID 30220 died... 11:10:54.373586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30220): Terminated: ok {rc=0} 11:10:54.460543 bus /sierra_3: Setting Powered False 11:10:55.561377 bus /sierra_3: Setting Powered False 11:10:56.678818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 11:10:57.929093 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:57.934413 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:10:57.983545 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:10:58.010399 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:10:58.063277 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:10:58.113084 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:10:58.139469 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:10:58.686019 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 11:10:58.691472 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:58.702394 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:10:58.737192 tst handover.py: using LAC 21061 11:10:58.867755 tst handover.py: using RAC 151 11:10:58.996251 tst handover.py: using CellId 21061 11:10:59.124667 tst handover.py: using BVCI 21062 11:10:59.245554 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:10:59.294732 tst handover.py: using LAC 21062 11:10:59.425049 tst handover.py: using RAC 152 11:10:59.552296 tst handover.py: using CellId 21062 11:10:59.674789 tst handover.py: using BVCI 21063 11:10:59.787851 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:59.799147 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:59.810054 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:59.821775 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:59.833448 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:59.844845 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:10:59.967183 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:11:00.083045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:00.529418 run create_hlr_db(pid=30226): Launched 11:11:00.646277 bus /sierra_2: Setting Powered False 11:11:01.706320 run create_hlr_db(pid=30226): Terminated: ok {rc=0} 11:11:02.115692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30228): Launched 11:11:02.437042 run osmo-hlr_10.42.42.2(pid=30229): Launched 11:11:02.554832 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:03.056468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30231): Launched 11:11:03.360867 run osmo-stp_10.42.42.5(pid=30232): Launched 11:11:03.476904 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:04.005223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30234): Launched 11:11:04.310305 run osmo-msc_10.42.42.6(pid=30235): Launched 11:11:04.483520 run osmo-stp_10.42.42.5(pid=30232): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30232)] 11:11:04.612916 run osmo-stp_10.42.42.5(pid=30232): stdout: | (launched: 2022-12-09_11:11:03.304773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:04.741635 run osmo-stp_10.42.42.5(pid=30232): stderr: | 20221209111103472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111103472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111103473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111103473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111103474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111103474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111103474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:04.868746 run osmo-stp_10.42.42.5(pid=30232): stdout: | (launched: 2022-12-09_11:11:03.304773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:04.990079 run osmo-stp_10.42.42.5(pid=30232): stderr: | 20221209111103472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111103472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111103473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111103473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111103474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111103474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111103474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:05.135147 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30232): Process ended prematurely: osmo-stp_10.42.42.5(pid=30232) [trial-2358↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30232)] [trial-2358↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 11:11:05.143869 tst handover.py:18: Test FAILED (6.4 sec) 11:11:05.170650 run osmo-hlr_10.42.42.2(pid=30229): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30229)] 11:11:05.218859 run osmo-hlr_10.42.42.2(pid=30229): stdout: | (launched: 2022-12-09_11:11:02.380736) 11:11:05.268604 run osmo-hlr_10.42.42.2(pid=30229): stderr: | 20221209111102554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111102554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111102554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111102554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111102554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111102554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111102567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111102576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111102576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111102576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:05.337813 run osmo-msc_10.42.42.6(pid=30235): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30235)] 11:11:05.385837 run osmo-msc_10.42.42.6(pid=30235): stdout: | (launched: 2022-12-09_11:11:04.254250) 11:11:05.435492 run osmo-msc_10.42.42.6(pid=30235): stderr: | 20221209111104522 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111104522 DLGLOBAL DEBUG validating counter group 0x7f4b6753fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111104522 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111104523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111104523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111104523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111104525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111104525 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111104525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111104525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:05.485850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30228): Terminating (SIGTERM) 11:11:05.526075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30231): Terminating (SIGTERM) 11:11:05.566362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30234): Terminating (SIGTERM) 11:11:05.606960 --- ParallelTerminationStrategy: PID 30228 died... 11:11:05.626147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30228): Terminated: ok {rc=0} 11:11:05.671044 --- ParallelTerminationStrategy: PID 30231 died... 11:11:05.689966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30231): Terminated: ok {rc=0} 11:11:05.734839 --- ParallelTerminationStrategy: PID 30234 died... 11:11:05.753915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30234): Terminated: ok {rc=0} 11:11:05.838669 bus /sierra_3: Setting Powered False 11:11:06.940149 bus /sierra_3: Setting Powered False 11:11:08.059838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:11:09.314363 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:09.321301 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:11:09.367424 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:11:09.394685 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:11:09.450190 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:11:09.496171 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:11:09.523185 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:11:10.074691 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:11:10.080256 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:11:10.091871 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:11:10.126767 tst handover.py: using LAC 21063 11:11:10.257480 tst handover.py: using RAC 153 11:11:10.386981 tst handover.py: using CellId 21063 11:11:10.515332 tst handover.py: using BVCI 21064 11:11:10.634441 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:11:10.679972 tst handover.py: using LAC 21064 11:11:10.810018 tst handover.py: using RAC 154 11:11:10.938678 tst handover.py: using CellId 21064 11:11:11.068832 tst handover.py: using BVCI 21065 11:11:11.189703 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:11:11.201662 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:11:11.213330 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:11:11.224519 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:11:11.235848 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:11:11.247101 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:11:11.364395 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:11:11.480894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:11.929453 run create_hlr_db(pid=30240): Launched 11:11:12.048368 bus /sierra_2: Setting Powered False 11:11:13.109938 run create_hlr_db(pid=30240): Terminated: ok {rc=0} 11:11:13.530503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Launched 11:11:13.860322 run osmo-hlr_10.42.42.2(pid=30243): Launched 11:11:13.986082 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:14.528152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Launched 11:11:14.857599 run osmo-stp_10.42.42.5(pid=30246): Launched 11:11:14.984778 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:15.552022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30248): Launched 11:11:15.889571 run osmo-msc_10.42.42.6(pid=30249): Launched 11:11:16.267862 run osmo-stp_10.42.42.5(pid=30246): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] 11:11:16.599163 run osmo-stp_10.42.42.5(pid=30246): stdout: | (launched: 2022-12-09_11:11:14.797432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:16.763835 run osmo-stp_10.42.42.5(pid=30246): stderr: | 20221209111114989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111114989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111114990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111114990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111114991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111114991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111114991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:16.895134 run osmo-stp_10.42.42.5(pid=30246): stdout: | (launched: 2022-12-09_11:11:14.797432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:17.022709 run osmo-stp_10.42.42.5(pid=30246): stderr: | 20221209111114989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111114989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111114990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111114990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111114991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111114991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111114991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:17.174292 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30246): Process ended prematurely: osmo-stp_10.42.42.5(pid=30246) [trial-2358↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] [trial-2358↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 11:11:17.183017 tst handover.py:18: Test FAILED (7.1 sec) 11:11:17.211549 run osmo-hlr_10.42.42.2(pid=30243): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30243)] 11:11:17.261226 run osmo-hlr_10.42.42.2(pid=30243): stdout: | (launched: 2022-12-09_11:11:13.800033) 11:11:17.314278 run osmo-hlr_10.42.42.2(pid=30243): stderr: | 20221209111113998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111113998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111113998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111113998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111113998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111113998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111114010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111114021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111114021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111114021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:17.387275 run osmo-msc_10.42.42.6(pid=30249): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30249)] 11:11:17.437286 run osmo-msc_10.42.42.6(pid=30249): stdout: | (launched: 2022-12-09_11:11:15.821762) 11:11:17.490165 run osmo-msc_10.42.42.6(pid=30249): stderr: | 20221209111116463 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111116463 DLGLOBAL DEBUG validating counter group 0x7f67bf622c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111116463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111116463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111116463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111116463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111116465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111116466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111116466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111116466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:17.543043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Terminating (SIGTERM) 11:11:17.584923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Terminating (SIGTERM) 11:11:17.626987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30248): Terminating (SIGTERM) 11:11:17.669334 --- ParallelTerminationStrategy: PID 30242 died... 11:11:17.689421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Terminated: ok {rc=0} 11:11:17.735859 --- ParallelTerminationStrategy: PID 30245 died... 11:11:17.755528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Terminated: ok {rc=0} 11:11:17.801863 --- ParallelTerminationStrategy: PID 30248 died... 11:11:17.821539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30248): Terminated: ok {rc=0} 11:11:17.910158 bus /sierra_3: Setting Powered False 11:11:19.010965 bus /sierra_3: Setting Powered False 11:11:20.130062 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:11:21.383590 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:21.388829 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:11:21.438652 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:11:21.465073 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:11:21.514962 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:11:21.564289 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:11:21.590690 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:11:22.142945 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:11:22.148423 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:22.159515 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:11:22.193386 tst handover.py: using LAC 21065 11:11:22.313572 tst handover.py: using RAC 155 11:11:22.442512 tst handover.py: using CellId 21065 11:11:22.569919 tst handover.py: using BVCI 21066 11:11:22.690984 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:11:22.740485 tst handover.py: using LAC 21066 11:11:22.869430 tst handover.py: using RAC 156 11:11:22.996657 tst handover.py: using CellId 21066 11:11:23.123213 tst handover.py: using BVCI 21067 11:11:23.244208 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:23.255609 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:23.266941 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:23.278781 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:23.290581 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:23.302321 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:11:23.418910 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:11:23.534073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:23.981519 run create_hlr_db(pid=30254): Launched 11:11:24.099494 bus /sierra_2: Setting Powered False 11:11:25.164896 run create_hlr_db(pid=30254): Terminated: ok {rc=0} 11:11:25.591657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30256): Launched 11:11:25.918292 run osmo-hlr_10.42.42.2(pid=30257): Launched 11:11:26.044667 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:26.578432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30259): Launched 11:11:26.906097 run osmo-stp_10.42.42.5(pid=30260): Launched 11:11:27.031955 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:27.595278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30262): Launched 11:11:27.923390 run osmo-msc_10.42.42.6(pid=30263): Launched 11:11:28.107421 run osmo-stp_10.42.42.5(pid=30260): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30260)] 11:11:28.245529 run osmo-stp_10.42.42.5(pid=30260): stdout: | (launched: 2022-12-09_11:11:26.846243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:28.383657 run osmo-stp_10.42.42.5(pid=30260): stderr: | 20221209111127037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111127037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111127038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111127038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111127039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111127039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111127039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:28.520050 run osmo-stp_10.42.42.5(pid=30260): stdout: | (launched: 2022-12-09_11:11:26.846243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:28.650158 run osmo-stp_10.42.42.5(pid=30260): stderr: | 20221209111127037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111127037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111127038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111127038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111127039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111127039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111127039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:28.806261 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30260): Process ended prematurely: osmo-stp_10.42.42.5(pid=30260) [trial-2358↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30260)] [trial-2358↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 11:11:28.815472 tst handover.py:18: Test FAILED (6.7 sec) 11:11:28.843617 run osmo-hlr_10.42.42.2(pid=30257): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30257)] 11:11:28.894209 run osmo-hlr_10.42.42.2(pid=30257): stdout: | (launched: 2022-12-09_11:11:25.858634) 11:11:28.946586 run osmo-hlr_10.42.42.2(pid=30257): stderr: | 20221209111126055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111126055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111126055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111126055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111126055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111126055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111126067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111126078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111126078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111126078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:29.019524 run osmo-msc_10.42.42.6(pid=30263): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30263)] 11:11:29.069990 run osmo-msc_10.42.42.6(pid=30263): stdout: | (launched: 2022-12-09_11:11:27.863467) 11:11:29.122112 run osmo-msc_10.42.42.6(pid=30263): stderr: | 20221209111128185 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111128185 DLGLOBAL DEBUG validating counter group 0x7f918c4a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111128185 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111128185 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111128186 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111128186 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111128187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111128188 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111128188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111128188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:29.174486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30256): Terminating (SIGTERM) 11:11:29.216727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30259): Terminating (SIGTERM) 11:11:29.258729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30262): Terminating (SIGTERM) 11:11:29.301011 --- ParallelTerminationStrategy: PID 30256 died... 11:11:29.320890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30256): Terminated: ok {rc=0} 11:11:29.367619 --- ParallelTerminationStrategy: PID 30259 died... 11:11:29.387325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30259): Terminated: ok {rc=0} 11:11:29.433732 --- ParallelTerminationStrategy: PID 30262 died... 11:11:29.453501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30262): Terminated: ok {rc=0} 11:11:29.541323 bus /sierra_3: Setting Powered False 11:11:30.639962 bus /sierra_3: Setting Powered False 11:11:31.762983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 11:11:33.035901 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:33.042800 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:11:33.081060 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:11:33.108246 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:11:33.160065 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:11:33.197323 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:11:33.224678 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:11:33.776751 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 11:11:33.782126 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:33.793351 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:11:33.827358 tst handover.py: using LAC 21067 11:11:33.954438 tst handover.py: using RAC 157 11:11:34.082233 tst handover.py: using CellId 21067 11:11:34.208895 tst handover.py: using BVCI 21068 11:11:34.328098 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:11:34.362757 tst handover.py: using LAC 21068 11:11:34.489629 tst handover.py: using RAC 158 11:11:34.609401 tst handover.py: using CellId 21068 11:11:34.728467 tst handover.py: using BVCI 21069 11:11:34.845325 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:34.856712 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:34.867845 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:34.878874 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:34.889563 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:34.900165 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:11:35.026627 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:11:35.140569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:35.587750 run create_hlr_db(pid=30277): Launched 11:11:35.704347 bus /sierra_2: Setting Powered False 11:11:36.765565 run create_hlr_db(pid=30277): Terminated: ok {rc=0} 11:11:37.165359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Launched 11:11:37.470174 run osmo-hlr_10.42.42.2(pid=30280): Launched 11:11:37.590525 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:38.101948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Launched 11:11:38.406543 run osmo-stp_10.42.42.5(pid=30283): Launched 11:11:38.525802 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:39.052128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30285): Launched 11:11:39.381776 run osmo-msc_10.42.42.6(pid=30286): Launched 11:11:39.565806 run osmo-stp_10.42.42.5(pid=30283): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] 11:11:39.703915 run osmo-stp_10.42.42.5(pid=30283): stdout: | (launched: 2022-12-09_11:11:38.350432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:39.841581 run osmo-stp_10.42.42.5(pid=30283): stderr: | 20221209111138516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111138517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111138517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111138517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111138518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111138518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111138518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:39.977788 run osmo-stp_10.42.42.5(pid=30283): stdout: | (launched: 2022-12-09_11:11:38.350432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:40.107243 run osmo-stp_10.42.42.5(pid=30283): stderr: | 20221209111138516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111138517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111138517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111138517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111138518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111138518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111138518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:40.262622 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30283): Process ended prematurely: osmo-stp_10.42.42.5(pid=30283) [trial-2358↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] [trial-2358↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 11:11:40.271737 tst handover.py:18: Test FAILED (6.5 sec) 11:11:40.299273 run osmo-hlr_10.42.42.2(pid=30280): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30280)] 11:11:40.349391 run osmo-hlr_10.42.42.2(pid=30280): stdout: | (launched: 2022-12-09_11:11:37.414063) 11:11:40.401374 run osmo-hlr_10.42.42.2(pid=30280): stderr: | 20221209111137588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111137588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111137588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111137588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111137588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111137588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111137600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111137608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111137608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111137608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:40.473608 run osmo-msc_10.42.42.6(pid=30286): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30286)] 11:11:40.523700 run osmo-msc_10.42.42.6(pid=30286): stdout: | (launched: 2022-12-09_11:11:39.322195) 11:11:40.575406 run osmo-msc_10.42.42.6(pid=30286): stderr: | 20221209111139640 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111139641 DLGLOBAL DEBUG validating counter group 0x7f84d9813c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111139641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111139641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111139641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111139641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111139643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111139643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111139643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111139644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:40.627859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Terminating (SIGTERM) 11:11:40.669789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Terminating (SIGTERM) 11:11:40.711506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30285): Terminating (SIGTERM) 11:11:40.753539 --- ParallelTerminationStrategy: PID 30279 died... 11:11:40.773530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Terminated: ok {rc=0} 11:11:40.819718 --- ParallelTerminationStrategy: PID 30282 died... 11:11:40.839188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Terminated: ok {rc=0} 11:11:40.885271 --- ParallelTerminationStrategy: PID 30285 died... 11:11:40.904734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30285): Terminated: ok {rc=0} 11:11:40.993240 bus /sierra_3: Setting Powered False 11:11:42.092336 bus /sierra_3: Setting Powered False 11:11:43.207485 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 11:11:44.448577 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:44.454241 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:11:44.504142 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:11:44.531179 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:11:44.585301 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:11:44.635751 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:11:44.662810 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:11:45.207808 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 11:11:45.214128 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:45.226200 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:45.267290 tst handover.py: using LAC 21069 11:11:45.388812 tst handover.py: using RAC 159 11:11:45.507250 tst handover.py: using CellId 21069 11:11:45.626366 tst handover.py: using BVCI 21070 11:11:45.737830 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:45.783939 tst handover.py: using LAC 21070 11:11:45.927218 tst handover.py: using RAC 160 11:11:46.054236 tst handover.py: using CellId 21070 11:11:46.220715 tst handover.py: using BVCI 21071 11:11:46.335567 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:46.347415 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:46.359041 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:46.372497 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:46.384188 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:46.396907 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:46.516463 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:46.637748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:47.158977 run create_hlr_db(pid=30291): Launched 11:11:47.323966 bus /sierra_2: Setting Powered False 11:11:48.387887 run create_hlr_db(pid=30291): Terminated: ok {rc=0} 11:11:48.798165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30293): Launched 11:11:49.105242 run osmo-hlr_10.42.42.2(pid=30294): Launched 11:11:49.223013 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:49.721171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30296): Launched 11:11:50.025843 run osmo-stp_10.42.42.5(pid=30297): Launched 11:11:50.143730 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:50.671632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30299): Launched 11:11:50.977007 run osmo-msc_10.42.42.6(pid=30300): Launched 11:11:51.149528 run osmo-stp_10.42.42.5(pid=30297): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30297)] 11:11:51.279911 run osmo-stp_10.42.42.5(pid=30297): stdout: | (launched: 2022-12-09_11:11:49.969758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:51.408779 run osmo-stp_10.42.42.5(pid=30297): stderr: | 20221209111150138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111150138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111150138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111150139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111150139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111150139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111150139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:51.535844 run osmo-stp_10.42.42.5(pid=30297): stdout: | (launched: 2022-12-09_11:11:49.969758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:51.656722 run osmo-stp_10.42.42.5(pid=30297): stderr: | 20221209111150138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111150138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111150138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111150139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111150139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111150139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111150139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:51.802177 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30297): Process ended prematurely: osmo-stp_10.42.42.5(pid=30297) [trial-2358↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30297)] [trial-2358↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 11:11:51.810602 tst handover.py:18: Test FAILED (6.6 sec) 11:11:51.837509 run osmo-hlr_10.42.42.2(pid=30294): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30294)] 11:11:51.885776 run osmo-hlr_10.42.42.2(pid=30294): stdout: | (launched: 2022-12-09_11:11:49.048200) 11:11:51.935531 run osmo-hlr_10.42.42.2(pid=30294): stderr: | 20221209111149222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111149222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111149222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111149222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111149222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111149222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111149252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111149261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111149261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111149261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:52.005062 run osmo-msc_10.42.42.6(pid=30300): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30300)] 11:11:52.053187 run osmo-msc_10.42.42.6(pid=30300): stdout: | (launched: 2022-12-09_11:11:50.920620) 11:11:52.102894 run osmo-msc_10.42.42.6(pid=30300): stderr: | 20221209111151190 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111151190 DLGLOBAL DEBUG validating counter group 0x7fe0876b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111151190 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111151190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111151191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111151191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111151192 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111151193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111151193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111151193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:52.153255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30293): Terminating (SIGTERM) 11:11:52.193420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30296): Terminating (SIGTERM) 11:11:52.233803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30299): Terminating (SIGTERM) 11:11:52.274319 --- ParallelTerminationStrategy: PID 30293 died... 11:11:52.293551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30293): Terminated: ok {rc=0} 11:11:52.338105 --- ParallelTerminationStrategy: PID 30296 died... 11:11:52.356548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30296): Terminated: ok {rc=0} 11:11:52.401415 --- ParallelTerminationStrategy: PID 30299 died... 11:11:52.420201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30299): Terminated: ok {rc=0} 11:11:52.507762 bus /sierra_3: Setting Powered False 11:11:53.607464 bus /sierra_3: Setting Powered False 11:11:54.722147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 11:11:55.983548 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:55.989809 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:11:56.038600 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:11:56.065436 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:11:56.115204 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:11:56.162948 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:11:56.189573 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:11:56.740323 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 11:11:56.745531 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:56.756224 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:56.789732 tst handover.py: using LAC 21071 11:11:56.910491 tst handover.py: using RAC 161 11:11:57.034219 tst handover.py: using CellId 21071 11:11:57.152279 tst handover.py: using BVCI 21072 11:11:57.263328 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:57.308610 tst handover.py: using LAC 21072 11:11:57.428107 tst handover.py: using RAC 162 11:11:57.545946 tst handover.py: using CellId 21072 11:11:57.666195 tst handover.py: using BVCI 21073 11:11:57.776790 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:57.787743 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:57.798668 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:57.809701 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:57.820642 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:57.831637 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:57.950494 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:58.072884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:58.521405 run create_hlr_db(pid=30305): Launched 11:11:58.638339 bus /sierra_2: Setting Powered False 11:11:59.699264 run create_hlr_db(pid=30305): Terminated: ok {rc=0} 11:12:00.099615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30307): Launched 11:12:00.409752 run osmo-hlr_10.42.42.2(pid=30308): Launched 11:12:00.538010 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:01.088548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30310): Launched 11:12:01.423992 run osmo-stp_10.42.42.5(pid=30311): Launched 11:12:01.573227 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:02.264657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30313): Launched 11:12:02.605811 run osmo-msc_10.42.42.6(pid=30314): Launched 11:12:02.790606 run osmo-stp_10.42.42.5(pid=30311): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30311)] 11:12:02.928129 run osmo-stp_10.42.42.5(pid=30311): stdout: | (launched: 2022-12-09_11:12:01.361235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:03.066355 run osmo-stp_10.42.42.5(pid=30311): stderr: | 20221209111201749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111201749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111201749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111201750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111201750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111201750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111201750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:03.204749 run osmo-stp_10.42.42.5(pid=30311): stdout: | (launched: 2022-12-09_11:12:01.361235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:03.335545 run osmo-stp_10.42.42.5(pid=30311): stderr: | 20221209111201749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111201749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111201749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111201750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111201750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111201750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111201750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:03.491393 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30311): Process ended prematurely: osmo-stp_10.42.42.5(pid=30311) [trial-2358↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30311)] [trial-2358↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 11:12:03.500469 tst handover.py:18: Test FAILED (6.7 sec) 11:12:03.528515 run osmo-hlr_10.42.42.2(pid=30308): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30308)] 11:12:03.579307 run osmo-hlr_10.42.42.2(pid=30308): stdout: | (launched: 2022-12-09_11:12:00.349406) 11:12:03.631626 run osmo-hlr_10.42.42.2(pid=30308): stderr: | 20221209111200545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111200545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111200545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111200545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111200545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111200545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111200557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111200565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111200565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111200565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:03.704705 run osmo-msc_10.42.42.6(pid=30314): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30314)] 11:12:03.755275 run osmo-msc_10.42.42.6(pid=30314): stdout: | (launched: 2022-12-09_11:12:02.545352) 11:12:03.807475 run osmo-msc_10.42.42.6(pid=30314): stderr: | 20221209111202866 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111202867 DLGLOBAL DEBUG validating counter group 0x7fd5c04c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111202867 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111202867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111202867 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111202867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111202869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111202869 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111202870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111202870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:03.859626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30307): Terminating (SIGTERM) 11:12:03.901621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30310): Terminating (SIGTERM) 11:12:03.943834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30313): Terminating (SIGTERM) 11:12:03.986406 --- ParallelTerminationStrategy: PID 30307 died... 11:12:04.006584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30307): Terminated: ok {rc=0} 11:12:04.053307 --- ParallelTerminationStrategy: PID 30310 died... 11:12:04.073090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30310): Terminated: ok {rc=0} 11:12:04.119645 --- ParallelTerminationStrategy: PID 30313 died... 11:12:04.139370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30313): Terminated: ok {rc=0} 11:12:04.227694 bus /sierra_3: Setting Powered False 11:12:05.327606 bus /sierra_3: Setting Powered False 11:12:06.443506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:12:07.700905 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:07.706666 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:12:07.766137 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:12:07.793255 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:12:07.846399 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:12:07.906811 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:12:07.933971 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:12:08.487157 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:12:08.492617 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:08.504056 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:12:08.552677 tst handover.py: using LAC 21073 11:12:08.680392 tst handover.py: using RAC 163 11:12:08.807941 tst handover.py: using CellId 21073 11:12:08.935763 tst handover.py: using BVCI 21074 11:12:09.048181 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:12:09.092017 tst handover.py: using LAC 21074 11:12:09.214569 tst handover.py: using RAC 164 11:12:09.334316 tst handover.py: using CellId 21074 11:12:09.455792 tst handover.py: using BVCI 21075 11:12:09.569288 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:09.580229 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:09.590975 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:09.602147 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:09.613293 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:09.624187 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:12:09.743564 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:12:09.858883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:10.306355 run create_hlr_db(pid=30319): Launched 11:12:10.424661 bus /sierra_2: Setting Powered False 11:12:11.486057 run create_hlr_db(pid=30319): Terminated: ok {rc=0} 11:12:11.886491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30321): Launched 11:12:12.192702 run osmo-hlr_10.42.42.2(pid=30322): Launched 11:12:12.310570 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:12.824931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30324): Launched 11:12:13.130451 run osmo-stp_10.42.42.5(pid=30325): Launched 11:12:13.248695 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:13.775487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30327): Launched 11:12:14.082647 run osmo-msc_10.42.42.6(pid=30328): Launched 11:12:14.255662 run osmo-stp_10.42.42.5(pid=30325): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30325)] 11:12:14.384441 run osmo-stp_10.42.42.5(pid=30325): stdout: | (launched: 2022-12-09_11:12:13.074170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:14.512701 run osmo-stp_10.42.42.5(pid=30325): stderr: | 20221209111213243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111213243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111213243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111213244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111213244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111213245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111213245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:14.639401 run osmo-stp_10.42.42.5(pid=30325): stdout: | (launched: 2022-12-09_11:12:13.074170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:14.759850 run osmo-stp_10.42.42.5(pid=30325): stderr: | 20221209111213243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111213243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111213243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111213244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111213244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111213245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111213245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:14.904405 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30325): Process ended prematurely: osmo-stp_10.42.42.5(pid=30325) [trial-2358↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30325)] [trial-2358↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 11:12:14.912835 tst handover.py:18: Test FAILED (6.4 sec) 11:12:14.939586 run osmo-hlr_10.42.42.2(pid=30322): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30322)] 11:12:14.988003 run osmo-hlr_10.42.42.2(pid=30322): stdout: | (launched: 2022-12-09_11:12:12.136541) 11:12:15.037744 run osmo-hlr_10.42.42.2(pid=30322): stderr: | 20221209111212311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111212311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111212311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111212311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111212311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111212311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111212322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111212330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111212330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111212331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:15.106892 run osmo-msc_10.42.42.6(pid=30328): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30328)] 11:12:15.155042 run osmo-msc_10.42.42.6(pid=30328): stdout: | (launched: 2022-12-09_11:12:14.025301) 11:12:15.204877 run osmo-msc_10.42.42.6(pid=30328): stderr: | 20221209111214294 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111214295 DLGLOBAL DEBUG validating counter group 0x7f10940ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111214295 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111214295 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111214295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111214295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111214297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111214297 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111214297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111214298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:15.255049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30321): Terminating (SIGTERM) 11:12:15.294837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30324): Terminating (SIGTERM) 11:12:15.334617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30327): Terminating (SIGTERM) 11:12:15.374780 --- ParallelTerminationStrategy: PID 30321 died... 11:12:15.393873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30321): Terminated: ok {rc=0} 11:12:15.438536 --- ParallelTerminationStrategy: PID 30324 died... 11:12:15.456941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30324): Terminated: ok {rc=0} 11:12:15.501729 --- ParallelTerminationStrategy: PID 30327 died... 11:12:15.520336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30327): Terminated: ok {rc=0} 11:12:15.607355 bus /sierra_3: Setting Powered False 11:12:16.710300 bus /sierra_3: Setting Powered False 11:12:17.831195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:12:19.098385 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:19.103529 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:12:19.166562 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:12:19.193277 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:12:19.246842 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:12:19.310800 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:12:19.336851 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:12:19.886145 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:12:19.891313 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:19.902250 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:12:19.949479 tst handover.py: using LAC 21075 11:12:20.071554 tst handover.py: using RAC 165 11:12:20.193038 tst handover.py: using CellId 21075 11:12:20.313642 tst handover.py: using BVCI 21076 11:12:20.424843 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:12:20.473411 tst handover.py: using LAC 21076 11:12:20.594807 tst handover.py: using RAC 166 11:12:20.714598 tst handover.py: using CellId 21076 11:12:20.834585 tst handover.py: using BVCI 21077 11:12:20.947541 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:20.958493 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:20.969331 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:20.980387 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:20.991450 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:21.002521 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:12:21.122177 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:12:21.244838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:21.726683 run create_hlr_db(pid=30333): Launched 11:12:21.862648 bus /sierra_2: Setting Powered False 11:12:22.926995 run create_hlr_db(pid=30333): Terminated: ok {rc=0} 11:12:23.356137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30335): Launched 11:12:23.683788 run osmo-hlr_10.42.42.2(pid=30336): Launched 11:12:23.809279 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:24.347490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30338): Launched 11:12:24.675520 run osmo-stp_10.42.42.5(pid=30339): Launched 11:12:24.802235 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:25.367275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30341): Launched 11:12:25.696929 run osmo-msc_10.42.42.6(pid=30342): Launched 11:12:25.881661 run osmo-stp_10.42.42.5(pid=30339): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30339)] 11:12:26.020043 run osmo-stp_10.42.42.5(pid=30339): stdout: | (launched: 2022-12-09_11:12:24.615813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:26.158711 run osmo-stp_10.42.42.5(pid=30339): stderr: | 20221209111224806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111224806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111224806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111224807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111224807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111224807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111224807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:26.296052 run osmo-stp_10.42.42.5(pid=30339): stdout: | (launched: 2022-12-09_11:12:24.615813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:26.426952 run osmo-stp_10.42.42.5(pid=30339): stderr: | 20221209111224806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111224806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111224806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111224807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111224807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111224807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111224807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:26.583068 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30339): Process ended prematurely: osmo-stp_10.42.42.5(pid=30339) [trial-2358↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30339)] [trial-2358↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 11:12:26.592074 tst handover.py:18: Test FAILED (6.7 sec) 11:12:26.620101 run osmo-hlr_10.42.42.2(pid=30336): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30336)] 11:12:26.670915 run osmo-hlr_10.42.42.2(pid=30336): stdout: | (launched: 2022-12-09_11:12:23.623876) 11:12:26.723268 run osmo-hlr_10.42.42.2(pid=30336): stderr: | 20221209111223820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111223820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111223820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111223820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111223820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111223820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111223833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111223842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111223842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111223842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:26.796370 run osmo-msc_10.42.42.6(pid=30342): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30342)] 11:12:26.846997 run osmo-msc_10.42.42.6(pid=30342): stdout: | (launched: 2022-12-09_11:12:25.636712) 11:12:26.899464 run osmo-msc_10.42.42.6(pid=30342): stderr: | 20221209111225958 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111225958 DLGLOBAL DEBUG validating counter group 0x7fc0ee873c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111225958 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111225958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111225958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111225959 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111225960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111225961 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111225961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111225961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:26.952022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30335): Terminating (SIGTERM) 11:12:26.994192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30338): Terminating (SIGTERM) 11:12:27.036477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30341): Terminating (SIGTERM) 11:12:27.078782 --- ParallelTerminationStrategy: PID 30335 died... 11:12:27.099000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30335): Terminated: ok {rc=0} 11:12:27.145794 --- ParallelTerminationStrategy: PID 30338 died... 11:12:27.165596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30338): Terminated: ok {rc=0} 11:12:27.212001 --- ParallelTerminationStrategy: PID 30341 died... 11:12:27.231582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30341): Terminated: ok {rc=0} 11:12:27.321816 bus /sierra_3: Setting Powered False 11:12:28.423379 bus /sierra_3: Setting Powered False 11:12:29.543553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 11:12:30.812713 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:30.818214 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:12:30.887964 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:12:30.916677 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:12:30.982244 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:12:31.047171 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:12:31.075853 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:12:31.595616 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 11:12:31.602684 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:31.614658 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:12:31.668241 tst handover.py: using LAC 21077 11:12:31.827339 tst handover.py: using RAC 167 11:12:31.952466 tst handover.py: using CellId 21077 11:12:32.113221 tst handover.py: using BVCI 21078 11:12:32.227498 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:12:32.263687 tst handover.py: using LAC 21078 11:12:32.385961 tst handover.py: using RAC 168 11:12:32.509272 tst handover.py: using CellId 21078 11:12:32.630788 tst handover.py: using BVCI 21079 11:12:32.744640 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:32.755620 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:32.766583 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:32.778203 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:32.789810 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:32.801406 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:12:32.916012 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:12:33.035871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:33.517527 run create_hlr_db(pid=30347): Launched 11:12:33.652007 bus /sierra_2: Setting Powered False 11:12:34.717038 run create_hlr_db(pid=30347): Terminated: ok {rc=0} 11:12:35.131291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30349): Launched 11:12:35.437439 run osmo-hlr_10.42.42.2(pid=30350): Launched 11:12:35.554150 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:36.061477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30356): Launched 11:12:36.367367 run osmo-stp_10.42.42.5(pid=30357): Launched 11:12:36.483859 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:37.009184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30359): Launched 11:12:37.314125 run osmo-msc_10.42.42.6(pid=30360): Launched 11:12:37.486240 run osmo-stp_10.42.42.5(pid=30357): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30357)] 11:12:37.615308 run osmo-stp_10.42.42.5(pid=30357): stdout: | (launched: 2022-12-09_11:12:36.311155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:37.743982 run osmo-stp_10.42.42.5(pid=30357): stderr: | 20221209111236478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111236478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111236478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111236479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111236479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111236479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111236479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:37.870435 run osmo-stp_10.42.42.5(pid=30357): stdout: | (launched: 2022-12-09_11:12:36.311155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:37.991024 run osmo-stp_10.42.42.5(pid=30357): stderr: | 20221209111236478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111236478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111236478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111236479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111236479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111236479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111236479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:38.135408 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30357): Process ended prematurely: osmo-stp_10.42.42.5(pid=30357) [trial-2358↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30357)] [trial-2358↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 11:12:38.143827 tst handover.py:18: Test FAILED (6.5 sec) 11:12:38.170626 run osmo-hlr_10.42.42.2(pid=30350): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30350)] 11:12:38.218834 run osmo-hlr_10.42.42.2(pid=30350): stdout: | (launched: 2022-12-09_11:12:35.381417) 11:12:38.268389 run osmo-hlr_10.42.42.2(pid=30350): stderr: | 20221209111235555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111235555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111235555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111235555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111235555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111235555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111235567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111235578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111235578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111235578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:38.337645 run osmo-msc_10.42.42.6(pid=30360): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30360)] 11:12:38.385523 run osmo-msc_10.42.42.6(pid=30360): stdout: | (launched: 2022-12-09_11:12:37.257541) 11:12:38.434842 run osmo-msc_10.42.42.6(pid=30360): stderr: | 20221209111237531 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111237531 DLGLOBAL DEBUG validating counter group 0x7fd08c81cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111237531 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111237532 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111237532 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111237532 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111237534 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111237534 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111237534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111237534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:38.484648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30349): Terminating (SIGTERM) 11:12:38.524571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30356): Terminating (SIGTERM) 11:12:38.564841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30359): Terminating (SIGTERM) 11:12:38.605256 --- ParallelTerminationStrategy: PID 30349 died... 11:12:38.624414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30349): Terminated: ok {rc=0} 11:12:38.668942 --- ParallelTerminationStrategy: PID 30356 died... 11:12:38.687625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30356): Terminated: ok {rc=0} 11:12:38.731901 --- ParallelTerminationStrategy: PID 30359 died... 11:12:38.750574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30359): Terminated: ok {rc=0} 11:12:38.837026 bus /sierra_3: Setting Powered False 11:12:39.937519 bus /sierra_3: Setting Powered False 11:12:41.053227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 11:12:42.314991 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:42.321191 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:12:42.385462 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:12:42.412701 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:12:42.468107 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:12:42.530470 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:12:42.556668 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:12:43.104506 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 11:12:43.109754 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:43.120484 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:12:43.167514 tst handover.py: using LAC 21079 11:12:43.292546 tst handover.py: using RAC 169 11:12:43.421085 tst handover.py: using CellId 21079 11:12:43.547604 tst handover.py: using BVCI 21080 11:12:43.660033 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:12:43.710940 tst handover.py: using LAC 21080 11:12:43.830248 tst handover.py: using RAC 170 11:12:43.950083 tst handover.py: using CellId 21080 11:12:44.070151 tst handover.py: using BVCI 21081 11:12:44.183198 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:44.193959 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:44.204517 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:44.215385 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:44.226251 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:44.237507 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:12:44.353535 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:12:44.471175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:44.919004 run create_hlr_db(pid=30365): Launched 11:12:45.035160 bus /sierra_2: Setting Powered False 11:12:46.099578 run create_hlr_db(pid=30365): Terminated: ok {rc=0} 11:12:46.537068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30367): Launched 11:12:46.883776 run osmo-hlr_10.42.42.2(pid=30368): Launched 11:12:47.046270 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:47.629819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30370): Launched 11:12:47.959028 run osmo-stp_10.42.42.5(pid=30371): Launched 11:12:48.083495 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:48.651724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30373): Launched 11:12:48.982784 run osmo-msc_10.42.42.6(pid=30374): Launched 11:12:49.168210 run osmo-stp_10.42.42.5(pid=30371): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30371)] 11:12:49.308206 run osmo-stp_10.42.42.5(pid=30371): stdout: | (launched: 2022-12-09_11:12:47.898770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:49.448273 run osmo-stp_10.42.42.5(pid=30371): stderr: | 20221209111248089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111248089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111248089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111248090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111248090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111248090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111248090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:49.586524 run osmo-stp_10.42.42.5(pid=30371): stdout: | (launched: 2022-12-09_11:12:47.898770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:49.717871 run osmo-stp_10.42.42.5(pid=30371): stderr: | 20221209111248089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111248089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111248089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111248090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111248090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111248090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111248090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:49.875151 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30371): Process ended prematurely: osmo-stp_10.42.42.5(pid=30371) [trial-2358↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30371)] [trial-2358↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 11:12:49.884124 tst handover.py:18: Test FAILED (6.8 sec) 11:12:49.912008 run osmo-hlr_10.42.42.2(pid=30368): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30368)] 11:12:49.962550 run osmo-hlr_10.42.42.2(pid=30368): stdout: | (launched: 2022-12-09_11:12:46.823315) 11:12:50.014991 run osmo-hlr_10.42.42.2(pid=30368): stderr: | 20221209111247178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111247178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111247178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111247178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111247178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111247179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111247192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111247201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111247201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111247201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:50.087666 run osmo-msc_10.42.42.6(pid=30374): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30374)] 11:12:50.138231 run osmo-msc_10.42.42.6(pid=30374): stdout: | (launched: 2022-12-09_11:12:48.921259) 11:12:50.190380 run osmo-msc_10.42.42.6(pid=30374): stderr: | 20221209111249243 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111249243 DLGLOBAL DEBUG validating counter group 0x7fc41d1f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111249244 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111249244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111249244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111249244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111249246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111249246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111249246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111249246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:50.243177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30367): Terminating (SIGTERM) 11:12:50.286065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30370): Terminating (SIGTERM) 11:12:50.328482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30373): Terminating (SIGTERM) 11:12:50.371040 --- ParallelTerminationStrategy: PID 30367 died... 11:12:50.391238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30367): Terminated: ok {rc=0} 11:12:50.437743 --- ParallelTerminationStrategy: PID 30370 died... 11:12:50.457457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30370): Terminated: ok {rc=0} 11:12:50.503596 --- ParallelTerminationStrategy: PID 30373 died... 11:12:50.523300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30373): Terminated: ok {rc=0} 11:12:50.611613 bus /sierra_3: Setting Powered False 11:12:51.711527 bus /sierra_3: Setting Powered False 11:12:52.829181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 11:12:54.102028 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:54.107299 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:12:54.169086 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:12:54.195734 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:12:54.249403 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:12:54.312093 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:12:54.338646 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:12:54.886221 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 11:12:54.891457 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:54.902467 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:12:54.950221 tst handover.py: using LAC 21081 11:12:55.073357 tst handover.py: using RAC 171 11:12:55.193800 tst handover.py: using CellId 21081 11:12:55.317374 tst handover.py: using BVCI 21082 11:12:55.431364 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:12:55.478710 tst handover.py: using LAC 21082 11:12:55.602698 tst handover.py: using RAC 172 11:12:55.729488 tst handover.py: using CellId 21082 11:12:55.859237 tst handover.py: using BVCI 21083 11:12:55.981320 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:55.992817 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:56.004170 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:56.018929 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:56.030376 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:56.041137 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:12:56.161954 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:12:56.281381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:56.765395 run create_hlr_db(pid=30379): Launched 11:12:56.900912 bus /sierra_2: Setting Powered False 11:12:57.966320 run create_hlr_db(pid=30379): Terminated: ok {rc=0} 11:12:58.398270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30381): Launched 11:12:58.729872 run osmo-hlr_10.42.42.2(pid=30382): Launched 11:12:58.855707 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:59.398968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30384): Launched 11:12:59.731150 run osmo-stp_10.42.42.5(pid=30385): Launched 11:12:59.859170 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:00.428639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30387): Launched 11:13:00.760845 run osmo-msc_10.42.42.6(pid=30388): Launched 11:13:01.039184 run osmo-stp_10.42.42.5(pid=30385): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30385)] 11:13:01.446473 run osmo-stp_10.42.42.5(pid=30385): stdout: | (launched: 2022-12-09_11:12:59.670410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:01.620367 run osmo-stp_10.42.42.5(pid=30385): stderr: | 20221209111259860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111259860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111259860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111259861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111259861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111259861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111259861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:01.783283 run osmo-stp_10.42.42.5(pid=30385): stdout: | (launched: 2022-12-09_11:12:59.670410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:01.920177 run osmo-stp_10.42.42.5(pid=30385): stderr: | 20221209111259860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111259860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111259860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111259861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111259861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111259861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111259861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:02.081949 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30385): Process ended prematurely: osmo-stp_10.42.42.5(pid=30385) [trial-2358↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30385)] [trial-2358↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 11:13:02.090929 tst handover.py:18: Test FAILED (7.2 sec) 11:13:02.119470 run osmo-hlr_10.42.42.2(pid=30382): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30382)] 11:13:02.171025 run osmo-hlr_10.42.42.2(pid=30382): stdout: | (launched: 2022-12-09_11:12:58.668866) 11:13:02.223888 run osmo-hlr_10.42.42.2(pid=30382): stderr: | 20221209111258866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111258866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111258866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111258866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111258867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111258867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111258879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111258888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111258888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111258888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:02.298079 run osmo-msc_10.42.42.6(pid=30388): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30388)] 11:13:02.349200 run osmo-msc_10.42.42.6(pid=30388): stdout: | (launched: 2022-12-09_11:13:00.699598) 11:13:02.401284 run osmo-msc_10.42.42.6(pid=30388): stderr: | 20221209111301120 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111301121 DLGLOBAL DEBUG validating counter group 0x7f74017acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111301122 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111301122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111301123 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111301123 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111301127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111301129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111301130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111301130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:02.453762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30381): Terminating (SIGTERM) 11:13:02.495741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30384): Terminating (SIGTERM) 11:13:02.538303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30387): Terminating (SIGTERM) 11:13:02.580566 --- ParallelTerminationStrategy: PID 30381 died... 11:13:02.600408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30381): Terminated: ok {rc=0} 11:13:02.647042 --- ParallelTerminationStrategy: PID 30384 died... 11:13:02.666737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30384): Terminated: ok {rc=0} 11:13:02.713141 --- ParallelTerminationStrategy: PID 30387 died... 11:13:02.732691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30387): Terminated: ok {rc=0} 11:13:02.820815 bus /sierra_3: Setting Powered False 11:13:03.922733 bus /sierra_3: Setting Powered False 11:13:05.040618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:13:06.315776 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:06.321478 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:13:06.382266 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:13:06.409876 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:13:06.463697 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:13:06.525236 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:13:06.552453 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:13:07.105900 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:13:07.112390 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:07.124661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:13:07.169301 tst handover.py: using LAC 21083 11:13:07.291799 tst handover.py: using RAC 173 11:13:07.414501 tst handover.py: using CellId 21083 11:13:07.538012 tst handover.py: using BVCI 21084 11:13:07.650569 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:13:07.699972 tst handover.py: using LAC 21084 11:13:07.822462 tst handover.py: using RAC 174 11:13:07.944924 tst handover.py: using CellId 21084 11:13:08.069062 tst handover.py: using BVCI 21085 11:13:08.182709 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:08.194118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:08.205388 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:08.216781 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:08.228102 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:08.239532 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:13:08.357302 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:13:08.476421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:08.962061 run create_hlr_db(pid=30393): Launched 11:13:09.098515 bus /sierra_2: Setting Powered False 11:13:10.164447 run create_hlr_db(pid=30393): Terminated: ok {rc=0} 11:13:10.580839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30395): Launched 11:13:10.889869 run osmo-hlr_10.42.42.2(pid=30396): Launched 11:13:11.008194 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:11.528353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30398): Launched 11:13:11.837030 run osmo-stp_10.42.42.5(pid=30399): Launched 11:13:11.955531 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:12.488277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30401): Launched 11:13:12.797721 run osmo-msc_10.42.42.6(pid=30402): Launched 11:13:12.970659 run osmo-stp_10.42.42.5(pid=30399): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30399)] 11:13:13.100728 run osmo-stp_10.42.42.5(pid=30399): stdout: | (launched: 2022-12-09_11:13:11.779984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:13.230853 run osmo-stp_10.42.42.5(pid=30399): stderr: | 20221209111311947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111311947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111311947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111311948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111311948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111311948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111311948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:13.358732 run osmo-stp_10.42.42.5(pid=30399): stdout: | (launched: 2022-12-09_11:13:11.779984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:13.480556 run osmo-stp_10.42.42.5(pid=30399): stderr: | 20221209111311947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111311947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111311947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111311948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111311948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111311948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111311948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:13.626816 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30399): Process ended prematurely: osmo-stp_10.42.42.5(pid=30399) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30399)] [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 11:13:13.635245 tst handover.py:18: Test FAILED (6.5 sec) 11:13:13.662137 run osmo-hlr_10.42.42.2(pid=30396): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30396)] 11:13:13.710457 run osmo-hlr_10.42.42.2(pid=30396): stdout: | (launched: 2022-12-09_11:13:10.833106) 11:13:13.760142 run osmo-hlr_10.42.42.2(pid=30396): stderr: | 20221209111311006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111311006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111311006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111311006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111311006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111311006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111311022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111311031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111311032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111311032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:13.829502 run osmo-msc_10.42.42.6(pid=30402): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30402)] 11:13:13.877426 run osmo-msc_10.42.42.6(pid=30402): stdout: | (launched: 2022-12-09_11:13:12.740515) 11:13:13.926765 run osmo-msc_10.42.42.6(pid=30402): stderr: | 20221209111313012 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111313012 DLGLOBAL DEBUG validating counter group 0x7f3e0723fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111313012 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111313012 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111313012 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111313012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111313014 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111313015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111313015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111313015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:13.976587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30395): Terminating (SIGTERM) 11:13:14.016306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30398): Terminating (SIGTERM) 11:13:14.055965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30401): Terminating (SIGTERM) 11:13:14.096102 --- ParallelTerminationStrategy: PID 30395 died... 11:13:14.115187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30395): Terminated: ok {rc=0} 11:13:14.159290 --- ParallelTerminationStrategy: PID 30398 died... 11:13:14.177842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30398): Terminated: ok {rc=0} 11:13:14.221544 --- ParallelTerminationStrategy: PID 30401 died... 11:13:14.239951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30401): Terminated: ok {rc=0} 11:13:14.323950 bus /sierra_3: Setting Powered False 11:13:15.421208 bus /sierra_3: Setting Powered False 11:13:16.532851 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 11:13:17.799864 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:17.805062 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:13:17.851601 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:13:17.877964 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:13:17.928801 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:13:17.975154 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:13:18.002095 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:13:18.554245 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 11:13:18.559361 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:18.570338 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:13:18.613635 tst handover.py: using LAC 21085 11:13:18.744884 tst handover.py: using RAC 175 11:13:18.872579 tst handover.py: using CellId 21085 11:13:19.005068 tst handover.py: using BVCI 21086 11:13:19.126669 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:13:19.162089 tst handover.py: using LAC 21086 11:13:19.289937 tst handover.py: using RAC 176 11:13:19.420404 tst handover.py: using CellId 21086 11:13:19.549051 tst handover.py: using BVCI 21087 11:13:19.668708 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:19.680191 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:19.691658 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:19.703053 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:19.714687 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:19.725957 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:13:19.842878 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:13:19.958448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:20.409634 run create_hlr_db(pid=30407): Launched 11:13:20.528753 bus /sierra_2: Setting Powered False 11:13:21.590374 run create_hlr_db(pid=30407): Terminated: ok {rc=0} 11:13:21.993139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30409): Launched 11:13:22.301354 run osmo-hlr_10.42.42.2(pid=30410): Launched 11:13:22.419620 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:22.935444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30412): Launched 11:13:23.243365 run osmo-stp_10.42.42.5(pid=30413): Launched 11:13:23.361685 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:23.892534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30415): Launched 11:13:24.201779 run osmo-msc_10.42.42.6(pid=30416): Launched 11:13:24.375668 run osmo-stp_10.42.42.5(pid=30413): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30413)] 11:13:24.506972 run osmo-stp_10.42.42.5(pid=30413): stdout: | (launched: 2022-12-09_11:13:23.186337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:24.638177 run osmo-stp_10.42.42.5(pid=30413): stderr: | 20221209111323354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111323354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111323355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111323355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111323356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111323356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111323356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:24.766900 run osmo-stp_10.42.42.5(pid=30413): stdout: | (launched: 2022-12-09_11:13:23.186337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:24.889909 run osmo-stp_10.42.42.5(pid=30413): stderr: | 20221209111323354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111323354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111323355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111323355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111323356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111323356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111323356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:25.036754 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30413): Process ended prematurely: osmo-stp_10.42.42.5(pid=30413) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30413)] [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 11:13:25.045165 tst handover.py:18: Test FAILED (6.5 sec) 11:13:25.072178 run osmo-hlr_10.42.42.2(pid=30410): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30410)] 11:13:25.120300 run osmo-hlr_10.42.42.2(pid=30410): stdout: | (launched: 2022-12-09_11:13:22.244315) 11:13:25.170475 run osmo-hlr_10.42.42.2(pid=30410): stderr: | 20221209111322419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111322419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111322419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111322419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111322419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111322420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111322432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111322440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111322440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111322440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:25.239833 run osmo-msc_10.42.42.6(pid=30416): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30416)] 11:13:25.287739 run osmo-msc_10.42.42.6(pid=30416): stdout: | (launched: 2022-12-09_11:13:24.144460) 11:13:25.337391 run osmo-msc_10.42.42.6(pid=30416): stderr: | 20221209111324415 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111324415 DLGLOBAL DEBUG validating counter group 0x7f71fb311c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111324416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111324416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111324416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111324416 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111324418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111324418 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111324418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111324418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:25.387496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30409): Terminating (SIGTERM) 11:13:25.427556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30412): Terminating (SIGTERM) 11:13:25.467532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30415): Terminating (SIGTERM) 11:13:25.507851 --- ParallelTerminationStrategy: PID 30409 died... 11:13:25.527079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30409): Terminated: ok {rc=0} 11:13:25.571815 --- ParallelTerminationStrategy: PID 30412 died... 11:13:25.590580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30412): Terminated: ok {rc=0} 11:13:25.634894 --- ParallelTerminationStrategy: PID 30415 died... 11:13:25.653574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30415): Terminated: ok {rc=0} 11:13:25.740055 bus /sierra_3: Setting Powered False 11:13:26.844097 bus /sierra_3: Setting Powered False 11:13:27.960933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 11:13:29.216157 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:29.222260 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:13:29.283365 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:13:29.310905 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:13:29.362910 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:13:29.423912 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:13:29.451313 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:13:30.006661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 11:13:30.012448 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:13:30.023979 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:13:30.072196 tst handover.py: using LAC 21087 11:13:30.202243 tst handover.py: using RAC 177 11:13:30.332023 tst handover.py: using CellId 21087 11:13:30.461796 tst handover.py: using BVCI 21088 11:13:30.576189 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:13:30.623317 tst handover.py: using LAC 21088 11:13:30.744326 tst handover.py: using RAC 178 11:13:30.879071 tst handover.py: using CellId 21088 11:13:31.026428 tst handover.py: using BVCI 21089 11:13:31.153545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:13:31.166046 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:13:31.180016 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:13:31.193120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:13:31.205706 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:13:31.218651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:13:31.355735 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:13:31.507028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:32.006564 run create_hlr_db(pid=30421): Launched 11:13:32.174749 bus /sierra_2: Setting Powered False 11:13:33.236114 run create_hlr_db(pid=30421): Terminated: ok {rc=0} 11:13:33.641350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30423): Launched 11:13:33.952144 run osmo-hlr_10.42.42.2(pid=30424): Launched 11:13:34.070259 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:34.581835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30426): Launched 11:13:34.892297 run osmo-stp_10.42.42.5(pid=30427): Launched 11:13:35.011082 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:35.542832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30429): Launched 11:13:35.853357 run osmo-msc_10.42.42.6(pid=30430): Launched 11:13:36.026581 run osmo-stp_10.42.42.5(pid=30427): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30427)] 11:13:36.156751 run osmo-stp_10.42.42.5(pid=30427): stdout: | (launched: 2022-12-09_11:13:34.834900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:36.286894 run osmo-stp_10.42.42.5(pid=30427): stderr: | 20221209111335003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111335003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111335003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111335003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111335004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111335004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111335004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:36.414966 run osmo-stp_10.42.42.5(pid=30427): stdout: | (launched: 2022-12-09_11:13:34.834900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:36.537102 run osmo-stp_10.42.42.5(pid=30427): stderr: | 20221209111335003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111335003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111335003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111335003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111335004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111335004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111335004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:36.683287 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30427): Process ended prematurely: osmo-stp_10.42.42.5(pid=30427) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30427)] [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 11:13:36.691996 tst handover.py:18: Test FAILED (6.7 sec) 11:13:36.719155 run osmo-hlr_10.42.42.2(pid=30424): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30424)] 11:13:36.767355 run osmo-hlr_10.42.42.2(pid=30424): stdout: | (launched: 2022-12-09_11:13:33.894424) 11:13:36.817055 run osmo-hlr_10.42.42.2(pid=30424): stderr: | 20221209111334068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111334068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111334068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111334068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111334068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111334069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111334081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111334090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111334090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111334090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:36.886175 run osmo-msc_10.42.42.6(pid=30430): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30430)] 11:13:36.934021 run osmo-msc_10.42.42.6(pid=30430): stdout: | (launched: 2022-12-09_11:13:35.795602) 11:13:36.983859 run osmo-msc_10.42.42.6(pid=30430): stderr: | 20221209111336066 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111336067 DLGLOBAL DEBUG validating counter group 0x7f03fbd05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111336067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111336067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111336067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111336067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111336069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111336069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111336070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111336070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:37.033919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30423): Terminating (SIGTERM) 11:13:37.073779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30426): Terminating (SIGTERM) 11:13:37.113734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30429): Terminating (SIGTERM) 11:13:37.153891 --- ParallelTerminationStrategy: PID 30423 died... 11:13:37.173179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30423): Terminated: ok {rc=0} 11:13:37.217724 --- ParallelTerminationStrategy: PID 30426 died... 11:13:37.236280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30426): Terminated: ok {rc=0} 11:13:37.280819 --- ParallelTerminationStrategy: PID 30429 died... 11:13:37.299960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30429): Terminated: ok {rc=0} 11:13:37.387072 bus /sierra_3: Setting Powered False 11:13:38.487336 bus /sierra_3: Setting Powered False 11:13:39.605967 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 11:13:40.881622 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:40.887639 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:13:40.947317 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:13:40.974639 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:13:41.027588 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:13:41.087395 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:13:41.114775 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:13:41.669076 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 11:13:41.674487 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:41.686104 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:13:41.730459 tst handover.py: using LAC 21089 11:13:41.861740 tst handover.py: using RAC 179 11:13:41.991958 tst handover.py: using CellId 21089 11:13:42.122187 tst handover.py: using BVCI 21090 11:13:42.243963 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:13:42.298443 tst handover.py: using LAC 21090 11:13:42.428424 tst handover.py: using RAC 180 11:13:42.558107 tst handover.py: using CellId 21090 11:13:42.678529 tst handover.py: using BVCI 21091 11:13:42.792691 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:42.803871 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:42.814790 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:42.826158 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:42.836877 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:42.848219 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:13:42.969390 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:13:43.085740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:43.539102 run create_hlr_db(pid=30436): Launched 11:13:43.659007 bus /sierra_2: Setting Powered False 11:13:44.720275 run create_hlr_db(pid=30436): Terminated: ok {rc=0} 11:13:45.125612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30438): Launched 11:13:45.437974 run osmo-hlr_10.42.42.2(pid=30439): Launched 11:13:45.556365 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:46.107103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30441): Launched 11:13:46.541566 run osmo-stp_10.42.42.5(pid=30442): Launched 11:13:46.854725 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:47.400173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30444): Launched 11:13:47.709985 run osmo-msc_10.42.42.6(pid=30445): Launched 11:13:47.886039 run osmo-stp_10.42.42.5(pid=30442): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30442)] 11:13:48.017472 run osmo-stp_10.42.42.5(pid=30442): stdout: | (launched: 2022-12-09_11:13:46.462494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:48.147618 run osmo-stp_10.42.42.5(pid=30442): stderr: | 20221209111346698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111346698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111346698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111346699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111346699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111346699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111346699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:48.276160 run osmo-stp_10.42.42.5(pid=30442): stdout: | (launched: 2022-12-09_11:13:46.462494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:48.398817 run osmo-stp_10.42.42.5(pid=30442): stderr: | 20221209111346698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111346698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111346698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111346699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111346699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111346699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111346699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:48.545702 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30442): Process ended prematurely: osmo-stp_10.42.42.5(pid=30442) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30442)] [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 11:13:48.553905 tst handover.py:18: Test FAILED (6.9 sec) 11:13:48.580665 run osmo-hlr_10.42.42.2(pid=30439): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30439)] 11:13:48.629085 run osmo-hlr_10.42.42.2(pid=30439): stdout: | (launched: 2022-12-09_11:13:45.380429) 11:13:48.679314 run osmo-hlr_10.42.42.2(pid=30439): stderr: | 20221209111345553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111345553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111345553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111345553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111345553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111345554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111345565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111345574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111345574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111345574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:48.748471 run osmo-msc_10.42.42.6(pid=30445): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30445)] 11:13:48.797092 run osmo-msc_10.42.42.6(pid=30445): stdout: | (launched: 2022-12-09_11:13:47.652367) 11:13:48.846753 run osmo-msc_10.42.42.6(pid=30445): stderr: | 20221209111347923 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111347923 DLGLOBAL DEBUG validating counter group 0x7f0d7d7a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111347923 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111347923 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111347924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111347924 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111347926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111347926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111347926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111347926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:48.896872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30438): Terminating (SIGTERM) 11:13:48.937204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30441): Terminating (SIGTERM) 11:13:48.977029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30444): Terminating (SIGTERM) 11:13:49.017297 --- ParallelTerminationStrategy: PID 30438 died... 11:13:49.035895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30438): Terminated: ok {rc=0} 11:13:49.080396 --- ParallelTerminationStrategy: PID 30441 died... 11:13:49.099186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30441): Terminated: ok {rc=0} 11:13:49.143272 --- ParallelTerminationStrategy: PID 30444 died... 11:13:49.162002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30444): Terminated: ok {rc=0} 11:13:49.249798 bus /sierra_3: Setting Powered False 11:13:50.349662 bus /sierra_3: Setting Powered False 11:13:51.463654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 11:13:52.726671 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:52.731842 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:13:52.783057 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:13:52.809712 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:13:52.862112 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:13:52.912776 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:13:52.939398 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:13:53.489624 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 11:13:53.494837 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:53.505815 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:13:53.553459 tst handover.py: using LAC 21091 11:13:53.676435 tst handover.py: using RAC 181 11:13:53.799368 tst handover.py: using CellId 21091 11:13:53.933608 tst handover.py: using BVCI 21092 11:13:54.049267 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:13:54.082779 tst handover.py: using LAC 21092 11:13:54.202324 tst handover.py: using RAC 182 11:13:54.323804 tst handover.py: using CellId 21092 11:13:54.442554 tst handover.py: using BVCI 21093 11:13:54.556588 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.567587 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.578440 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.589466 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.600496 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.611510 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:13:54.732288 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:13:54.855518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:55.341683 run create_hlr_db(pid=30451): Launched 11:13:55.478782 bus /sierra_2: Setting Powered False 11:13:56.543791 run create_hlr_db(pid=30451): Terminated: ok {rc=0} 11:13:56.975603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30453): Launched 11:13:57.309323 run osmo-hlr_10.42.42.2(pid=30454): Launched 11:13:57.436403 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:57.981506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30456): Launched 11:13:58.316575 run osmo-stp_10.42.42.5(pid=30457): Launched 11:13:58.445145 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:59.016940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30459): Launched 11:13:59.349171 run osmo-msc_10.42.42.6(pid=30460): Launched 11:13:59.535386 run osmo-stp_10.42.42.5(pid=30457): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30457)] 11:13:59.674579 run osmo-stp_10.42.42.5(pid=30457): stdout: | (launched: 2022-12-09_11:13:58.255058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:59.813835 run osmo-stp_10.42.42.5(pid=30457): stderr: | 20221209111358446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111358447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111358447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111358447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111358448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111358448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111358448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:59.950965 run osmo-stp_10.42.42.5(pid=30457): stdout: | (launched: 2022-12-09_11:13:58.255058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:00.082616 run osmo-stp_10.42.42.5(pid=30457): stderr: | 20221209111358446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111358447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111358447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111358447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111358448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111358448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111358448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:00.239334 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30457): Process ended prematurely: osmo-stp_10.42.42.5(pid=30457) [trial-2358↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30457)] [trial-2358↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 11:14:00.248347 tst handover.py:18: Test FAILED (6.7 sec) 11:14:00.276148 run osmo-hlr_10.42.42.2(pid=30454): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30454)] 11:14:00.326914 run osmo-hlr_10.42.42.2(pid=30454): stdout: | (launched: 2022-12-09_11:13:57.247876) 11:14:00.379208 run osmo-hlr_10.42.42.2(pid=30454): stderr: | 20221209111357445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111357445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111357445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111357446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111357446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111357446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111357459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111357468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111357468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111357468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:00.451497 run osmo-msc_10.42.42.6(pid=30460): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30460)] 11:14:00.501796 run osmo-msc_10.42.42.6(pid=30460): stdout: | (launched: 2022-12-09_11:13:59.287669) 11:14:00.553836 run osmo-msc_10.42.42.6(pid=30460): stderr: | 20221209111359609 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111359609 DLGLOBAL DEBUG validating counter group 0x7f9a4a6d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111359610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111359610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111359610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111359610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111359612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111359612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111359612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111359612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:00.606223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30453): Terminating (SIGTERM) 11:14:00.648289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30456): Terminating (SIGTERM) 11:14:00.690408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30459): Terminating (SIGTERM) 11:14:00.732706 --- ParallelTerminationStrategy: PID 30453 died... 11:14:00.752863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30453): Terminated: ok {rc=0} 11:14:00.799421 --- ParallelTerminationStrategy: PID 30456 died... 11:14:00.819127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30456): Terminated: ok {rc=0} 11:14:00.869905 --- ParallelTerminationStrategy: PID 30459 died... 11:14:00.890340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30459): Terminated: ok {rc=0} 11:14:00.987019 bus /sierra_3: Setting Powered False 11:14:02.108231 bus /sierra_3: Setting Powered False 11:14:03.252775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 11:14:04.528383 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:04.536055 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:14:04.602069 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:14:04.629589 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:14:04.690294 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:14:04.758554 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:14:04.785771 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:14:05.327147 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 11:14:05.332621 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:05.344126 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:14:05.393951 tst handover.py: using LAC 21093 11:14:05.524596 tst handover.py: using RAC 183 11:14:05.648940 tst handover.py: using CellId 21093 11:14:05.772415 tst handover.py: using BVCI 21094 11:14:05.887152 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:14:05.938840 tst handover.py: using LAC 21094 11:14:06.060570 tst handover.py: using RAC 184 11:14:06.181912 tst handover.py: using CellId 21094 11:14:06.303433 tst handover.py: using BVCI 21095 11:14:06.416713 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:06.427913 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:06.438901 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:06.450772 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:06.462586 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:06.474418 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:14:06.595163 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:14:06.717429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:07.170718 run create_hlr_db(pid=30465): Launched 11:14:07.290392 bus /sierra_2: Setting Powered False 11:14:08.351885 run create_hlr_db(pid=30465): Terminated: ok {rc=0} 11:14:08.755356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30467): Launched 11:14:09.064174 run osmo-hlr_10.42.42.2(pid=30468): Launched 11:14:09.184075 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:09.703437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30470): Launched 11:14:10.013355 run osmo-stp_10.42.42.5(pid=30471): Launched 11:14:10.131679 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:10.664754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30473): Launched 11:14:10.974145 run osmo-msc_10.42.42.6(pid=30474): Launched 11:14:11.148387 run osmo-stp_10.42.42.5(pid=30471): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30471)] 11:14:11.279734 run osmo-stp_10.42.42.5(pid=30471): stdout: | (launched: 2022-12-09_11:14:09.956098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:11.409271 run osmo-stp_10.42.42.5(pid=30471): stderr: | 20221209111410126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111410126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111410126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111410126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111410127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111410127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111410127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:11.537190 run osmo-stp_10.42.42.5(pid=30471): stdout: | (launched: 2022-12-09_11:14:09.956098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:11.659310 run osmo-stp_10.42.42.5(pid=30471): stderr: | 20221209111410126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111410126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111410126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111410126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111410127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111410127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111410127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:11.805544 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30471): Process ended prematurely: osmo-stp_10.42.42.5(pid=30471) [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30471)] [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 11:14:11.813805 tst handover.py:18: Test FAILED (6.5 sec) 11:14:11.840438 run osmo-hlr_10.42.42.2(pid=30468): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30468)] 11:14:11.888923 run osmo-hlr_10.42.42.2(pid=30468): stdout: | (launched: 2022-12-09_11:14:09.007079) 11:14:11.938446 run osmo-hlr_10.42.42.2(pid=30468): stderr: | 20221209111409182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111409182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111409182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111409182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111409182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111409182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111409195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111409204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111409204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111409204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:12.007301 run osmo-msc_10.42.42.6(pid=30474): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30474)] 11:14:12.055060 run osmo-msc_10.42.42.6(pid=30474): stdout: | (launched: 2022-12-09_11:14:10.916678) 11:14:12.104263 run osmo-msc_10.42.42.6(pid=30474): stderr: | 20221209111411188 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111411188 DLGLOBAL DEBUG validating counter group 0x7f43fcc42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111411188 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111411188 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111411188 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111411188 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111411190 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111411191 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111411191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111411191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:12.154512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30467): Terminating (SIGTERM) 11:14:12.194548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30470): Terminating (SIGTERM) 11:14:12.234078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30473): Terminating (SIGTERM) 11:14:12.273932 --- ParallelTerminationStrategy: PID 30467 died... 11:14:12.292900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30467): Terminated: ok {rc=0} 11:14:12.337400 --- ParallelTerminationStrategy: PID 30470 died... 11:14:12.355784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30470): Terminated: ok {rc=0} 11:14:12.399929 --- ParallelTerminationStrategy: PID 30473 died... 11:14:12.418468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30473): Terminated: ok {rc=0} 11:14:12.504067 bus /sierra_3: Setting Powered False 11:14:13.604796 bus /sierra_3: Setting Powered False 11:14:14.720678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 11:14:16.028675 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:16.036423 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:14:16.103219 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:14:16.131897 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:14:16.191849 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:14:16.290035 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:14:16.326839 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:14:16.831363 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 11:14:16.838960 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:16.855499 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:16.916710 tst handover.py: using LAC 21095 11:14:17.050988 tst handover.py: using RAC 185 11:14:17.211178 tst handover.py: using CellId 21095 11:14:17.344021 tst handover.py: using BVCI 21096 11:14:17.465779 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:17.515003 tst handover.py: using LAC 21096 11:14:17.644823 tst handover.py: using RAC 186 11:14:17.774130 tst handover.py: using CellId 21096 11:14:17.905410 tst handover.py: using BVCI 21097 11:14:18.025693 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:18.037479 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:18.048832 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:18.060278 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:18.071707 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:18.083078 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:18.201152 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:18.321486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:18.806023 run create_hlr_db(pid=30479): Launched 11:14:18.943103 bus /sierra_2: Setting Powered False 11:14:20.007568 run create_hlr_db(pid=30479): Terminated: ok {rc=0} 11:14:20.421626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30481): Launched 11:14:20.732112 run osmo-hlr_10.42.42.2(pid=30482): Launched 11:14:20.849350 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:21.365881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30484): Launched 11:14:21.674237 run osmo-stp_10.42.42.5(pid=30485): Launched 11:14:21.794031 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:22.324006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30487): Launched 11:14:22.632552 run osmo-msc_10.42.42.6(pid=30488): Launched 11:14:22.805773 run osmo-stp_10.42.42.5(pid=30485): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30485)] 11:14:22.935935 run osmo-stp_10.42.42.5(pid=30485): stdout: | (launched: 2022-12-09_11:14:21.616461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:23.066319 run osmo-stp_10.42.42.5(pid=30485): stderr: | 20221209111421784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111421784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111421784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111421785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111421785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111421785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111421785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:23.193896 run osmo-stp_10.42.42.5(pid=30485): stdout: | (launched: 2022-12-09_11:14:21.616461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:23.315848 run osmo-stp_10.42.42.5(pid=30485): stderr: | 20221209111421784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111421784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111421784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111421785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111421785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111421785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111421785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:23.461957 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30485): Process ended prematurely: osmo-stp_10.42.42.5(pid=30485) [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30485)] [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 11:14:23.470485 tst handover.py:18: Test FAILED (6.6 sec) 11:14:23.496942 run osmo-hlr_10.42.42.2(pid=30482): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30482)] 11:14:23.545256 run osmo-hlr_10.42.42.2(pid=30482): stdout: | (launched: 2022-12-09_11:14:20.675002) 11:14:23.595103 run osmo-hlr_10.42.42.2(pid=30482): stderr: | 20221209111420851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111420851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111420851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111420851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111420851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111420851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111420864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111420874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111420874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111420874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:23.664116 run osmo-msc_10.42.42.6(pid=30488): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30488)] 11:14:23.711953 run osmo-msc_10.42.42.6(pid=30488): stdout: | (launched: 2022-12-09_11:14:22.575557) 11:14:23.761363 run osmo-msc_10.42.42.6(pid=30488): stderr: | 20221209111422845 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111422845 DLGLOBAL DEBUG validating counter group 0x7f6861eecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111422845 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111422845 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111422845 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111422845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111422847 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111422847 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111422848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111422848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:23.811557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30481): Terminating (SIGTERM) 11:14:23.851677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30484): Terminating (SIGTERM) 11:14:23.891650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30487): Terminating (SIGTERM) 11:14:23.932016 --- ParallelTerminationStrategy: PID 30481 died... 11:14:23.951174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30481): Terminated: ok {rc=0} 11:14:23.995742 --- ParallelTerminationStrategy: PID 30484 died... 11:14:24.014351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30484): Terminated: ok {rc=0} 11:14:24.058545 --- ParallelTerminationStrategy: PID 30487 died... 11:14:24.077341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30487): Terminated: ok {rc=0} 11:14:24.163465 bus /sierra_3: Setting Powered False 11:14:25.263153 bus /sierra_3: Setting Powered False 11:14:26.378451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 11:14:27.652743 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:27.659282 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:14:27.710916 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:14:27.737141 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:14:27.792234 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:14:27.842639 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:14:27.869107 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:14:28.418517 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 11:14:28.423709 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:28.434526 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:14:28.468894 tst handover.py: using LAC 21097 11:14:28.589382 tst handover.py: using RAC 187 11:14:28.719403 tst handover.py: using CellId 21097 11:14:28.841553 tst handover.py: using BVCI 21098 11:14:28.962596 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:14:29.010998 tst handover.py: using LAC 21098 11:14:29.140756 tst handover.py: using RAC 188 11:14:29.268607 tst handover.py: using CellId 21098 11:14:29.397276 tst handover.py: using BVCI 21099 11:14:29.517281 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:29.528601 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:29.539719 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:29.551135 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:29.562417 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:29.573530 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:14:29.689927 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:14:29.804755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:30.256885 run create_hlr_db(pid=30493): Launched 11:14:30.375812 bus /sierra_2: Setting Powered False 11:14:31.440440 run create_hlr_db(pid=30493): Terminated: ok {rc=0} 11:14:31.853578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30495): Launched 11:14:32.181779 run osmo-hlr_10.42.42.2(pid=30496): Launched 11:14:32.302147 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:32.820590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30498): Launched 11:14:33.129784 run osmo-stp_10.42.42.5(pid=30499): Launched 11:14:33.248594 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:33.782319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30501): Launched 11:14:34.093256 run osmo-msc_10.42.42.6(pid=30502): Launched 11:14:34.265960 run osmo-stp_10.42.42.5(pid=30499): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30499)] 11:14:34.397264 run osmo-stp_10.42.42.5(pid=30499): stdout: | (launched: 2022-12-09_11:14:33.072517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:34.527035 run osmo-stp_10.42.42.5(pid=30499): stderr: | 20221209111433242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111433242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111433243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111433243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111433244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111433244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111433244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:34.655083 run osmo-stp_10.42.42.5(pid=30499): stdout: | (launched: 2022-12-09_11:14:33.072517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:34.777784 run osmo-stp_10.42.42.5(pid=30499): stderr: | 20221209111433242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111433242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111433243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111433243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111433244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111433244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111433244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:34.924524 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30499): Process ended prematurely: osmo-stp_10.42.42.5(pid=30499) [trial-2358↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30499)] [trial-2358↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 11:14:34.933147 tst handover.py:18: Test FAILED (6.5 sec) 11:14:34.960131 run osmo-hlr_10.42.42.2(pid=30496): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30496)] 11:14:35.008490 run osmo-hlr_10.42.42.2(pid=30496): stdout: | (launched: 2022-12-09_11:14:32.123387) 11:14:35.058312 run osmo-hlr_10.42.42.2(pid=30496): stderr: | 20221209111432301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111432301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111432301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111432301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111432301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111432301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111432314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111432322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111432322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111432322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:35.127731 run osmo-msc_10.42.42.6(pid=30502): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30502)] 11:14:35.175841 run osmo-msc_10.42.42.6(pid=30502): stdout: | (launched: 2022-12-09_11:14:34.035851) 11:14:35.225810 run osmo-msc_10.42.42.6(pid=30502): stderr: | 20221209111434307 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111434307 DLGLOBAL DEBUG validating counter group 0x7f9921152c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111434307 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111434307 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111434308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111434308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111434310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111434310 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111434310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111434311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:35.276431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30495): Terminating (SIGTERM) 11:14:35.316633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30498): Terminating (SIGTERM) 11:14:35.356853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30501): Terminating (SIGTERM) 11:14:35.397227 --- ParallelTerminationStrategy: PID 30495 died... 11:14:35.416381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30495): Terminated: ok {rc=0} 11:14:35.461330 --- ParallelTerminationStrategy: PID 30498 died... 11:14:35.480012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30498): Terminated: ok {rc=0} 11:14:35.524903 --- ParallelTerminationStrategy: PID 30501 died... 11:14:35.544046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30501): Terminated: ok {rc=0} 11:14:35.630741 bus /sierra_3: Setting Powered False 11:14:36.730570 bus /sierra_3: Setting Powered False 11:14:37.844489 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 11:14:39.102813 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:39.108582 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:14:39.159918 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:14:39.187249 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:14:39.240381 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:14:39.291817 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:14:39.319417 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:14:39.871009 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 11:14:39.876431 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:39.887719 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:39.923272 tst handover.py: using LAC 21099 11:14:40.053385 tst handover.py: using RAC 189 11:14:40.182621 tst handover.py: using CellId 21099 11:14:40.312646 tst handover.py: using BVCI 21100 11:14:40.434882 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:40.487045 tst handover.py: using LAC 21100 11:14:40.620903 tst handover.py: using RAC 190 11:14:40.749846 tst handover.py: using CellId 21100 11:14:40.878049 tst handover.py: using BVCI 21101 11:14:40.992018 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:41.003135 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:41.014135 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:41.026063 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:41.037276 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:41.048329 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:41.163523 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:41.281315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:41.736022 run create_hlr_db(pid=30507): Launched 11:14:41.853579 bus /sierra_2: Setting Powered False 11:14:42.915941 run create_hlr_db(pid=30507): Terminated: ok {rc=0} 11:14:43.320454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30509): Launched 11:14:43.629106 run osmo-hlr_10.42.42.2(pid=30510): Launched 11:14:43.746541 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:44.253335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30512): Launched 11:14:44.563545 run osmo-stp_10.42.42.5(pid=30513): Launched 11:14:44.682960 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:45.214408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30515): Launched 11:14:45.525479 run osmo-msc_10.42.42.6(pid=30516): Launched 11:14:45.699305 run osmo-stp_10.42.42.5(pid=30513): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30513)] 11:14:45.830962 run osmo-stp_10.42.42.5(pid=30513): stdout: | (launched: 2022-12-09_11:14:44.506320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:45.999643 run osmo-stp_10.42.42.5(pid=30513): stderr: | 20221209111444675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111444675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111444675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111444676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111444676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111444676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111444676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:46.132024 run osmo-stp_10.42.42.5(pid=30513): stdout: | (launched: 2022-12-09_11:14:44.506320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:46.257791 run osmo-stp_10.42.42.5(pid=30513): stderr: | 20221209111444675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111444675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111444675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111444676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111444676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111444676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111444676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:46.408930 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30513): Process ended prematurely: osmo-stp_10.42.42.5(pid=30513) [trial-2358↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30513)] [trial-2358↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 11:14:46.418497 tst handover.py:18: Test FAILED (6.5 sec) 11:14:46.448539 run osmo-hlr_10.42.42.2(pid=30510): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30510)] 11:14:46.499400 run osmo-hlr_10.42.42.2(pid=30510): stdout: | (launched: 2022-12-09_11:14:43.571663) 11:14:46.552111 run osmo-hlr_10.42.42.2(pid=30510): stderr: | 20221209111443746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111443746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111443746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111443746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111443747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111443747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111443758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111443766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111443767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111443767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:46.624731 run osmo-msc_10.42.42.6(pid=30516): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30516)] 11:14:46.675541 run osmo-msc_10.42.42.6(pid=30516): stdout: | (launched: 2022-12-09_11:14:45.468003) 11:14:46.727590 run osmo-msc_10.42.42.6(pid=30516): stderr: | 20221209111445740 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111445740 DLGLOBAL DEBUG validating counter group 0x7f9e6987cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111445740 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111445741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111445741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111445741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111445743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111445743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111445743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111445743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:46.780538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30509): Terminating (SIGTERM) 11:14:46.823326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30512): Terminating (SIGTERM) 11:14:46.865820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30515): Terminating (SIGTERM) 11:14:46.909177 --- ParallelTerminationStrategy: PID 30509 died... 11:14:46.929182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30509): Terminated: ok {rc=0} 11:14:46.977259 --- ParallelTerminationStrategy: PID 30512 died... 11:14:46.997055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30512): Terminated: ok {rc=0} 11:14:47.045111 --- ParallelTerminationStrategy: PID 30515 died... 11:14:47.065134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30515): Terminated: ok {rc=0} 11:14:47.155186 bus /sierra_3: Setting Powered False 11:14:48.257832 bus /sierra_3: Setting Powered False 11:14:49.375501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2358 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 11:14:50.636793 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:50.642249 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:14:50.704782 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:14:50.731558 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:14:50.784908 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:14:50.847555 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:14:50.874389 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:14:51.422551 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2358 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 11:14:51.428136 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:51.439101 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:51.491316 tst handover.py: using LAC 21101 11:14:51.612756 tst handover.py: using RAC 191 11:14:51.732801 tst handover.py: using CellId 21101 11:14:51.852696 tst handover.py: using BVCI 21102 11:14:51.965457 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:52.011678 tst handover.py: using LAC 21102 11:14:52.145772 tst handover.py: using RAC 192 11:14:52.275549 tst handover.py: using CellId 21102 11:14:52.405849 tst handover.py: using BVCI 21103 11:14:52.527243 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:52.538861 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:52.550355 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:52.562090 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:52.573726 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:52.585060 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:52.701290 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:52.824857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:53.312193 run create_hlr_db(pid=30521): Launched 11:14:53.449219 bus /sierra_2: Setting Powered False 11:14:54.514819 run create_hlr_db(pid=30521): Terminated: ok {rc=0} 11:14:54.931458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30523): Launched 11:14:55.242000 run osmo-hlr_10.42.42.2(pid=30524): Launched 11:14:55.361543 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:55.881878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30526): Launched 11:14:56.191874 run osmo-stp_10.42.42.5(pid=30527): Launched 11:14:56.310847 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:56.845202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30529): Launched 11:14:57.155566 run osmo-msc_10.42.42.6(pid=30530): Launched 11:14:57.328703 run osmo-stp_10.42.42.5(pid=30527): ERR: Terminated: ERROR {rc=1} [trial-2358↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30527)] 11:14:57.459153 run osmo-stp_10.42.42.5(pid=30527): stdout: | (launched: 2022-12-09_11:14:56.134487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:57.589520 run osmo-stp_10.42.42.5(pid=30527): stderr: | 20221209111456304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111456304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111456304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111456305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111456305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111456305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111456305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:57.718056 run osmo-stp_10.42.42.5(pid=30527): stdout: | (launched: 2022-12-09_11:14:56.134487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:57.840331 run osmo-stp_10.42.42.5(pid=30527): stderr: | 20221209111456304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209111456304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209111456304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209111456305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209111456305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209111456305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209111456305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:57.987295 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=30527): Process ended prematurely: osmo-stp_10.42.42.5(pid=30527) [trial-2358↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30527)] [trial-2358↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 11:14:57.995802 tst handover.py:18: Test FAILED (6.6 sec) 11:14:58.022633 run osmo-hlr_10.42.42.2(pid=30524): ERR: Terminated: ERROR {rc=237} [trial-2358↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30524)] 11:14:58.071542 run osmo-hlr_10.42.42.2(pid=30524): stdout: | (launched: 2022-12-09_11:14:55.184544) 11:14:58.121817 run osmo-hlr_10.42.42.2(pid=30524): stderr: | 20221209111455358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209111455358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209111455358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209111455358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209111455358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209111455358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209111455370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209111455378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209111455378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209111455378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:58.191638 run osmo-msc_10.42.42.6(pid=30530): ERR: Terminated: ERROR {rc=2} [trial-2358↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30530)] 11:14:58.239998 run osmo-msc_10.42.42.6(pid=30530): stdout: | (launched: 2022-12-09_11:14:57.098269) 11:14:58.290330 run osmo-msc_10.42.42.6(pid=30530): stderr: | 20221209111457370 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209111457370 DLGLOBAL DEBUG validating counter group 0x7fdfda9a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209111457370 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209111457370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209111457370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209111457370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209111457372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209111457372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209111457373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209111457373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:58.341087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30523): Terminating (SIGTERM) 11:14:58.381567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30526): Terminating (SIGTERM) 11:14:58.422079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30529): Terminating (SIGTERM) 11:14:58.462814 --- ParallelTerminationStrategy: PID 30523 died... 11:14:58.482393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30523): Terminated: ok {rc=0} 11:14:58.527606 --- ParallelTerminationStrategy: PID 30526 died... 11:14:58.546586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30526): Terminated: ok {rc=0} 11:14:58.591415 --- ParallelTerminationStrategy: PID 30529 died... 11:14:58.610458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30529): Terminated: ok {rc=0} 11:14:58.697789 bus /sierra_3: Setting Powered False 11:14:59.797467 bus /sierra_3: Setting Powered False 11:15:00.928674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2358 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 11:15:02.212577 tst trial-2358: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358/run.2022-12-09_09-50-18/trial-2358.xml -------------------------------------------------------------------------------------------- trial-2358 FAIL -------------------------------------------------------------------------------------------- 11:15:04.161822 tst trial-2358: trial-2358: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=22094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22094) [trial-2358↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22094)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.4 sec) Error: osmo-stp_10.42.42.5(pid=22105): Process ended prematurely: osmo-stp_10.42.42.5(pid=22105) [trial-2358↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22105)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22114) [trial-2358↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22114)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22395): Process ended prematurely: osmo-stp_10.42.42.5(pid=22395) [trial-2358↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22395)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22411): Process ended prematurely: osmo-stp_10.42.42.5(pid=22411) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22411)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22423): Process ended prematurely: osmo-stp_10.42.42.5(pid=22423) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22448): Process ended prematurely: osmo-stp_10.42.42.5(pid=22448) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22448)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22465): Process ended prematurely: osmo-stp_10.42.42.5(pid=22465) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22465)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22476): Process ended prematurely: osmo-stp_10.42.42.5(pid=22476) [trial-2358↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22476)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22491): Process ended prematurely: osmo-stp_10.42.42.5(pid=22491) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22491)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22502): Process ended prematurely: osmo-stp_10.42.42.5(pid=22502) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22502)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22516): Process ended prematurely: osmo-stp_10.42.42.5(pid=22516) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22516)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22527): Process ended prematurely: osmo-stp_10.42.42.5(pid=22527) [trial-2358↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22527)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22544): Process ended prematurely: osmo-stp_10.42.42.5(pid=22544) [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22544)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22556): Process ended prematurely: osmo-stp_10.42.42.5(pid=22556) [trial-2358↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22556)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22572): Process ended prematurely: osmo-stp_10.42.42.5(pid=22572) [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22572)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22583): Process ended prematurely: osmo-stp_10.42.42.5(pid=22583) [trial-2358↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22583)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22597): Process ended prematurely: osmo-stp_10.42.42.5(pid=22597) [trial-2358↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22597)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22608): Process ended prematurely: osmo-stp_10.42.42.5(pid=22608) [trial-2358↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22608)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=22626): Process ended prematurely: osmo-stp_10.42.42.5(pid=22626) [trial-2358↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22626)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22638): Process ended prematurely: osmo-stp_10.42.42.5(pid=22638) [trial-2358↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22638)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22656): Process ended prematurely: osmo-stp_10.42.42.5(pid=22656) [trial-2358↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22656)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22667): Process ended prematurely: osmo-stp_10.42.42.5(pid=22667) [trial-2358↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22667)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22677): Process ended prematurely: osmo-stp_10.42.42.5(pid=22677) [trial-2358↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22677)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22694): Process ended prematurely: osmo-stp_10.42.42.5(pid=22694) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22706): Process ended prematurely: osmo-stp_10.42.42.5(pid=22706) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22706)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22727): Process ended prematurely: osmo-stp_10.42.42.5(pid=22727) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22727)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22737): Process ended prematurely: osmo-stp_10.42.42.5(pid=22737) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22737)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22747): Process ended prematurely: osmo-stp_10.42.42.5(pid=22747) [trial-2358↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22747)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=22764): Process ended prematurely: osmo-stp_10.42.42.5(pid=22764) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22764)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22776): Process ended prematurely: osmo-stp_10.42.42.5(pid=22776) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22776)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22795): Process ended prematurely: osmo-stp_10.42.42.5(pid=22795) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22795)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22805): Process ended prematurely: osmo-stp_10.42.42.5(pid=22805) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22805)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22815): Process ended prematurely: osmo-stp_10.42.42.5(pid=22815) [trial-2358↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22815)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=22833): Process ended prematurely: osmo-stp_10.42.42.5(pid=22833) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22833)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22845): Process ended prematurely: osmo-stp_10.42.42.5(pid=22845) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22845)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22864): Process ended prematurely: osmo-stp_10.42.42.5(pid=22864) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22864)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22874): Process ended prematurely: osmo-stp_10.42.42.5(pid=22874) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22874)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22894): Process ended prematurely: osmo-stp_10.42.42.5(pid=22894) [trial-2358↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22894)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=23259): Process ended prematurely: osmo-stp_10.42.42.5(pid=23259) [trial-2358↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23259)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=23447): Process ended prematurely: osmo-stp_10.42.42.5(pid=23447) [trial-2358↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23447)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=23456): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23456) [trial-2358↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23456)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23467): Process ended prematurely: osmo-stp_10.42.42.5(pid=23467) [trial-2358↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23467)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23476): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23476) [trial-2358↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23476)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23487): Process ended prematurely: osmo-stp_10.42.42.5(pid=23487) [trial-2358↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23487)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23501): Process ended prematurely: osmo-stp_10.42.42.5(pid=23501) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23501)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23512): Process ended prematurely: osmo-stp_10.42.42.5(pid=23512) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23512)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23526): Process ended prematurely: osmo-stp_10.42.42.5(pid=23526) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23526)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23537): Process ended prematurely: osmo-stp_10.42.42.5(pid=23537) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23537)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23551): Process ended prematurely: osmo-stp_10.42.42.5(pid=23551) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23551)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23562): Process ended prematurely: osmo-stp_10.42.42.5(pid=23562) [trial-2358↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23562)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23576): Process ended prematurely: osmo-stp_10.42.42.5(pid=23576) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23576)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23587): Process ended prematurely: osmo-stp_10.42.42.5(pid=23587) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23587)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23604): Process ended prematurely: osmo-stp_10.42.42.5(pid=23604) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23604)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23615): Process ended prematurely: osmo-stp_10.42.42.5(pid=23615) [trial-2358↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23615)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23629): Process ended prematurely: osmo-stp_10.42.42.5(pid=23629) [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23629)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23641): Process ended prematurely: osmo-stp_10.42.42.5(pid=23641) [trial-2358↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23641)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23655): Process ended prematurely: osmo-stp_10.42.42.5(pid=23655) [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23666): Process ended prematurely: osmo-stp_10.42.42.5(pid=23666) [trial-2358↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23666)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23680): Process ended prematurely: osmo-stp_10.42.42.5(pid=23680) [trial-2358↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23680)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23692): Process ended prematurely: osmo-stp_10.42.42.5(pid=23692) [trial-2358↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23692)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23710): Process ended prematurely: osmo-stp_10.42.42.5(pid=23710) [trial-2358↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23710)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23722): Process ended prematurely: osmo-stp_10.42.42.5(pid=23722) [trial-2358↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23722)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=23740): Process ended prematurely: osmo-stp_10.42.42.5(pid=23740) [trial-2358↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23740)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23750): Process ended prematurely: osmo-stp_10.42.42.5(pid=23750) [trial-2358↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23750)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23760): Process ended prematurely: osmo-stp_10.42.42.5(pid=23760) [trial-2358↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=23780): Process ended prematurely: osmo-stp_10.42.42.5(pid=23780) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23780)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23792): Process ended prematurely: osmo-stp_10.42.42.5(pid=23792) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23792)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=23810): Process ended prematurely: osmo-stp_10.42.42.5(pid=23810) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23810)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23820): Process ended prematurely: osmo-stp_10.42.42.5(pid=23820) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23820)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23830): Process ended prematurely: osmo-stp_10.42.42.5(pid=23830) [trial-2358↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23830)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23848): Process ended prematurely: osmo-stp_10.42.42.5(pid=23848) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23848)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23867): Process ended prematurely: osmo-stp_10.42.42.5(pid=23867) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23867)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=23885): Process ended prematurely: osmo-stp_10.42.42.5(pid=23885) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23885)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23895): Process ended prematurely: osmo-stp_10.42.42.5(pid=23895) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23895)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23905): Process ended prematurely: osmo-stp_10.42.42.5(pid=23905) [trial-2358↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23922): Process ended prematurely: osmo-stp_10.42.42.5(pid=23922) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23922)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23934): Process ended prematurely: osmo-stp_10.42.42.5(pid=23934) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23934)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23952): Process ended prematurely: osmo-stp_10.42.42.5(pid=23952) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23952)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23962): Process ended prematurely: osmo-stp_10.42.42.5(pid=23962) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23962)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23972): Process ended prematurely: osmo-stp_10.42.42.5(pid=23972) [trial-2358↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23972)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24257): Process ended prematurely: osmo-stp_10.42.42.5(pid=24257) [trial-2358↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24257)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24271): Process ended prematurely: osmo-stp_10.42.42.5(pid=24271) [trial-2358↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24271)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24281): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24281) [trial-2358↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24281)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24291): Process ended prematurely: osmo-stp_10.42.42.5(pid=24291) [trial-2358↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24291)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24300): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24300) [trial-2358↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24300)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=24311): Process ended prematurely: osmo-stp_10.42.42.5(pid=24311) [trial-2358↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24311)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24325): Process ended prematurely: osmo-stp_10.42.42.5(pid=24325) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24325)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24336): Process ended prematurely: osmo-stp_10.42.42.5(pid=24336) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24336)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24350): Process ended prematurely: osmo-stp_10.42.42.5(pid=24350) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24350)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24361): Process ended prematurely: osmo-stp_10.42.42.5(pid=24361) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24375): Process ended prematurely: osmo-stp_10.42.42.5(pid=24375) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24375)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24386): Process ended prematurely: osmo-stp_10.42.42.5(pid=24386) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24386)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24403): Process ended prematurely: osmo-stp_10.42.42.5(pid=24403) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24403)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24414): Process ended prematurely: osmo-stp_10.42.42.5(pid=24414) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24414)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24428): Process ended prematurely: osmo-stp_10.42.42.5(pid=24428) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24439): Process ended prematurely: osmo-stp_10.42.42.5(pid=24439) [trial-2358↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24439)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24454): Process ended prematurely: osmo-stp_10.42.42.5(pid=24454) [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24454)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24465): Process ended prematurely: osmo-stp_10.42.42.5(pid=24465) [trial-2358↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24465)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24479): Process ended prematurely: osmo-stp_10.42.42.5(pid=24479) [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24479)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24490): Process ended prematurely: osmo-stp_10.42.42.5(pid=24490) [trial-2358↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24490)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24505): Process ended prematurely: osmo-stp_10.42.42.5(pid=24505) [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24505)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24516): Process ended prematurely: osmo-stp_10.42.42.5(pid=24516) [trial-2358↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24516)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24530): Process ended prematurely: osmo-stp_10.42.42.5(pid=24530) [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24530)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24541): Process ended prematurely: osmo-stp_10.42.42.5(pid=24541) [trial-2358↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24541)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24555): Process ended prematurely: osmo-stp_10.42.42.5(pid=24555) [trial-2358↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24555)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24566): Process ended prematurely: osmo-stp_10.42.42.5(pid=24566) [trial-2358↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24566)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=24585): Process ended prematurely: osmo-stp_10.42.42.5(pid=24585) [trial-2358↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24585)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24597): Process ended prematurely: osmo-stp_10.42.42.5(pid=24597) [trial-2358↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24615): Process ended prematurely: osmo-stp_10.42.42.5(pid=24615) [trial-2358↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24625): Process ended prematurely: osmo-stp_10.42.42.5(pid=24625) [trial-2358↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24625)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24635): Process ended prematurely: osmo-stp_10.42.42.5(pid=24635) [trial-2358↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24635)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=24652): Process ended prematurely: osmo-stp_10.42.42.5(pid=24652) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24652)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24664): Process ended prematurely: osmo-stp_10.42.42.5(pid=24664) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24664)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24703): Process ended prematurely: osmo-stp_10.42.42.5(pid=24703) [trial-2358↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24703)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24720): Process ended prematurely: osmo-stp_10.42.42.5(pid=24720) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24720)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24732): Process ended prematurely: osmo-stp_10.42.42.5(pid=24732) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24732)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24760): Process ended prematurely: osmo-stp_10.42.42.5(pid=24760) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24760)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=25297): Process ended prematurely: osmo-stp_10.42.42.5(pid=25297) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25297)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25311): Process ended prematurely: osmo-stp_10.42.42.5(pid=25311) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25311)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=25329): Process ended prematurely: osmo-stp_10.42.42.5(pid=25329) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25329)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=25341): Process ended prematurely: osmo-stp_10.42.42.5(pid=25341) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25341)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25359): Process ended prematurely: osmo-stp_10.42.42.5(pid=25359) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25359)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25369): Process ended prematurely: osmo-stp_10.42.42.5(pid=25369) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25369)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25379): Process ended prematurely: osmo-stp_10.42.42.5(pid=25379) [trial-2358↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25379)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25397): Process ended prematurely: osmo-stp_10.42.42.5(pid=25397) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25397)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=25412): Process ended prematurely: osmo-stp_10.42.42.5(pid=25412) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25412)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=25430): Process ended prematurely: osmo-stp_10.42.42.5(pid=25430) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25430)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25440): Process ended prematurely: osmo-stp_10.42.42.5(pid=25440) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25440)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25450): Process ended prematurely: osmo-stp_10.42.42.5(pid=25450) [trial-2358↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25450)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25464): Process ended prematurely: osmo-stp_10.42.42.5(pid=25464) [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25464)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25477): Process ended prematurely: osmo-stp_10.42.42.5(pid=25477) [trial-2358↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25477)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25485) [trial-2358↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25485)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25495): Process ended prematurely: osmo-stp_10.42.42.5(pid=25495) [trial-2358↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25495)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25504): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25504) [trial-2358↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25504)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25514): Process ended prematurely: osmo-stp_10.42.42.5(pid=25514) [trial-2358↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25514)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25528): Process ended prematurely: osmo-stp_10.42.42.5(pid=25528) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25528)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25539): Process ended prematurely: osmo-stp_10.42.42.5(pid=25539) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25539)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25553): Process ended prematurely: osmo-stp_10.42.42.5(pid=25553) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25553)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25564): Process ended prematurely: osmo-stp_10.42.42.5(pid=25564) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25564)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25590): Process ended prematurely: osmo-stp_10.42.42.5(pid=25590) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25590)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25605): Process ended prematurely: osmo-stp_10.42.42.5(pid=25605) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25605)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25616): Process ended prematurely: osmo-stp_10.42.42.5(pid=25616) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25616)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25633): Process ended prematurely: osmo-stp_10.42.42.5(pid=25633) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25644): Process ended prematurely: osmo-stp_10.42.42.5(pid=25644) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25658): Process ended prematurely: osmo-stp_10.42.42.5(pid=25658) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25669): Process ended prematurely: osmo-stp_10.42.42.5(pid=25669) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25683): Process ended prematurely: osmo-stp_10.42.42.5(pid=25683) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25683)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25694): Process ended prematurely: osmo-stp_10.42.42.5(pid=25694) [trial-2358↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25694)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25709): Process ended prematurely: osmo-stp_10.42.42.5(pid=25709) [trial-2358↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25709)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25720): Process ended prematurely: osmo-stp_10.42.42.5(pid=25720) [trial-2358↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25720)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=25738): Process ended prematurely: osmo-stp_10.42.42.5(pid=25738) [trial-2358↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25738)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25750): Process ended prematurely: osmo-stp_10.42.42.5(pid=25750) [trial-2358↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25750)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=25768): Process ended prematurely: osmo-stp_10.42.42.5(pid=25768) [trial-2358↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25768)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25778): Process ended prematurely: osmo-stp_10.42.42.5(pid=25778) [trial-2358↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25778)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25788): Process ended prematurely: osmo-stp_10.42.42.5(pid=25788) [trial-2358↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25788)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=25809): Process ended prematurely: osmo-stp_10.42.42.5(pid=25809) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25809)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25821): Process ended prematurely: osmo-stp_10.42.42.5(pid=25821) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25821)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=26110): Process ended prematurely: osmo-stp_10.42.42.5(pid=26110) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26110)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26122): Process ended prematurely: osmo-stp_10.42.42.5(pid=26122) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26122)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26132): Process ended prematurely: osmo-stp_10.42.42.5(pid=26132) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26132)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26149): Process ended prematurely: osmo-stp_10.42.42.5(pid=26149) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26161): Process ended prematurely: osmo-stp_10.42.42.5(pid=26161) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26161)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26179): Process ended prematurely: osmo-stp_10.42.42.5(pid=26179) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26179)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26189): Process ended prematurely: osmo-stp_10.42.42.5(pid=26189) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26189)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26199): Process ended prematurely: osmo-stp_10.42.42.5(pid=26199) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26199)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26216): Process ended prematurely: osmo-stp_10.42.42.5(pid=26216) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26216)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=26228): Process ended prematurely: osmo-stp_10.42.42.5(pid=26228) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26228)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=26249): Process ended prematurely: osmo-stp_10.42.42.5(pid=26249) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26249)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26259): Process ended prematurely: osmo-stp_10.42.42.5(pid=26259) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26259)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26269): Process ended prematurely: osmo-stp_10.42.42.5(pid=26269) [trial-2358↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26269)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26283): Process ended prematurely: osmo-stp_10.42.42.5(pid=26283) [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26283)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26297): Process ended prematurely: osmo-stp_10.42.42.5(pid=26297) [trial-2358↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26297)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26305) [trial-2358↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26305)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26316): Process ended prematurely: osmo-stp_10.42.42.5(pid=26316) [trial-2358↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26316)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26326) [trial-2358↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26326)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26336): Process ended prematurely: osmo-stp_10.42.42.5(pid=26336) [trial-2358↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26336)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26350): Process ended prematurely: osmo-stp_10.42.42.5(pid=26350) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26350)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26361): Process ended prematurely: osmo-stp_10.42.42.5(pid=26361) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26361)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26375): Process ended prematurely: osmo-stp_10.42.42.5(pid=26375) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26375)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26386): Process ended prematurely: osmo-stp_10.42.42.5(pid=26386) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26386)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26400): Process ended prematurely: osmo-stp_10.42.42.5(pid=26400) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26400)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26414): Process ended prematurely: osmo-stp_10.42.42.5(pid=26414) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26414)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26428): Process ended prematurely: osmo-stp_10.42.42.5(pid=26428) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26428)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26439): Process ended prematurely: osmo-stp_10.42.42.5(pid=26439) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26439)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26453): Process ended prematurely: osmo-stp_10.42.42.5(pid=26453) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26453)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26465): Process ended prematurely: osmo-stp_10.42.42.5(pid=26465) [trial-2358↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26465)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26479): Process ended prematurely: osmo-stp_10.42.42.5(pid=26479) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26479)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26490): Process ended prematurely: osmo-stp_10.42.42.5(pid=26490) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26490)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26504): Process ended prematurely: osmo-stp_10.42.42.5(pid=26504) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26504)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26517): Process ended prematurely: osmo-stp_10.42.42.5(pid=26517) [trial-2358↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26531): Process ended prematurely: osmo-stp_10.42.42.5(pid=26531) [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26531)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26542): Process ended prematurely: osmo-stp_10.42.42.5(pid=26542) [trial-2358↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26542)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26556): Process ended prematurely: osmo-stp_10.42.42.5(pid=26556) [trial-2358↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26556)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26567): Process ended prematurely: osmo-stp_10.42.42.5(pid=26567) [trial-2358↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26567)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=26588): Process ended prematurely: osmo-stp_10.42.42.5(pid=26588) [trial-2358↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26588)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=26600): Process ended prematurely: osmo-stp_10.42.42.5(pid=26600) [trial-2358↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26600)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26618): Process ended prematurely: osmo-stp_10.42.42.5(pid=26618) [trial-2358↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26618)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26628): Process ended prematurely: osmo-stp_10.42.42.5(pid=26628) [trial-2358↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26628)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26638): Process ended prematurely: osmo-stp_10.42.42.5(pid=26638) [trial-2358↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26638)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26655): Process ended prematurely: osmo-stp_10.42.42.5(pid=26655) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26655)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=26667): Process ended prematurely: osmo-stp_10.42.42.5(pid=26667) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26667)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26685): Process ended prematurely: osmo-stp_10.42.42.5(pid=26685) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26685)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=26696): Process ended prematurely: osmo-stp_10.42.42.5(pid=26696) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26696)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26706): Process ended prematurely: osmo-stp_10.42.42.5(pid=26706) [trial-2358↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26706)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26724): Process ended prematurely: osmo-stp_10.42.42.5(pid=26724) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26724)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=26736): Process ended prematurely: osmo-stp_10.42.42.5(pid=26736) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26736)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26754): Process ended prematurely: osmo-stp_10.42.42.5(pid=26754) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26754)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26767): Process ended prematurely: osmo-stp_10.42.42.5(pid=26767) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26767)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26777): Process ended prematurely: osmo-stp_10.42.42.5(pid=26777) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26777)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26795): Process ended prematurely: osmo-stp_10.42.42.5(pid=26795) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26795)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26808): Process ended prematurely: osmo-stp_10.42.42.5(pid=26808) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26808)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26827): Process ended prematurely: osmo-stp_10.42.42.5(pid=26827) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26827)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26837): Process ended prematurely: osmo-stp_10.42.42.5(pid=26837) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26837)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26847): Process ended prematurely: osmo-stp_10.42.42.5(pid=26847) [trial-2358↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26847)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26864): Process ended prematurely: osmo-stp_10.42.42.5(pid=26864) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26864)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26876): Process ended prematurely: osmo-stp_10.42.42.5(pid=26876) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26876)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26894): Process ended prematurely: osmo-stp_10.42.42.5(pid=26894) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26894)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26904): Process ended prematurely: osmo-stp_10.42.42.5(pid=26904) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26914): Process ended prematurely: osmo-stp_10.42.42.5(pid=26914) [trial-2358↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26931): Process ended prematurely: osmo-stp_10.42.42.5(pid=26931) [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26944): Process ended prematurely: osmo-stp_10.42.42.5(pid=26944) [trial-2358↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26944)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26952): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26952) [trial-2358↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26952)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26962): Process ended prematurely: osmo-stp_10.42.42.5(pid=26962) [trial-2358↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26962)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=26971): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26971) [trial-2358↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26971)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=26981): Process ended prematurely: osmo-stp_10.42.42.5(pid=26981) [trial-2358↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26981)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26995): Process ended prematurely: osmo-stp_10.42.42.5(pid=26995) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26995)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27006): Process ended prematurely: osmo-stp_10.42.42.5(pid=27006) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27006)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27021): Process ended prematurely: osmo-stp_10.42.42.5(pid=27021) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27032): Process ended prematurely: osmo-stp_10.42.42.5(pid=27032) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27032)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27046): Process ended prematurely: osmo-stp_10.42.42.5(pid=27046) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27046)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27057): Process ended prematurely: osmo-stp_10.42.42.5(pid=27057) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27057)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27071): Process ended prematurely: osmo-stp_10.42.42.5(pid=27071) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27071)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27082): Process ended prematurely: osmo-stp_10.42.42.5(pid=27082) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27082)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27097): Process ended prematurely: osmo-stp_10.42.42.5(pid=27097) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27097)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27110): Process ended prematurely: osmo-stp_10.42.42.5(pid=27110) [trial-2358↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27110)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27124): Process ended prematurely: osmo-stp_10.42.42.5(pid=27124) [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27124)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27135): Process ended prematurely: osmo-stp_10.42.42.5(pid=27135) [trial-2358↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27135)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=27421): Process ended prematurely: osmo-stp_10.42.42.5(pid=27421) [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27421)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=27432): Process ended prematurely: osmo-stp_10.42.42.5(pid=27432) [trial-2358↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27432)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27447): Process ended prematurely: osmo-stp_10.42.42.5(pid=27447) [trial-2358↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27447)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27459): Process ended prematurely: osmo-stp_10.42.42.5(pid=27459) [trial-2358↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27459)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27477): Process ended prematurely: osmo-stp_10.42.42.5(pid=27477) [trial-2358↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27477)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27489): Process ended prematurely: osmo-stp_10.42.42.5(pid=27489) [trial-2358↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27489)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27507): Process ended prematurely: osmo-stp_10.42.42.5(pid=27507) [trial-2358↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27507)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27517): Process ended prematurely: osmo-stp_10.42.42.5(pid=27517) [trial-2358↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27517)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27527): Process ended prematurely: osmo-stp_10.42.42.5(pid=27527) [trial-2358↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27527)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=27544): Process ended prematurely: osmo-stp_10.42.42.5(pid=27544) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27544)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=27559): Process ended prematurely: osmo-stp_10.42.42.5(pid=27559) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27559)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27577): Process ended prematurely: osmo-stp_10.42.42.5(pid=27577) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27587): Process ended prematurely: osmo-stp_10.42.42.5(pid=27587) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27587)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27597): Process ended prematurely: osmo-stp_10.42.42.5(pid=27597) [trial-2358↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27597)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27616): Process ended prematurely: osmo-stp_10.42.42.5(pid=27616) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27616)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27628): Process ended prematurely: osmo-stp_10.42.42.5(pid=27628) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27628)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27646): Process ended prematurely: osmo-stp_10.42.42.5(pid=27646) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27646)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27656): Process ended prematurely: osmo-stp_10.42.42.5(pid=27656) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27656)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27666): Process ended prematurely: osmo-stp_10.42.42.5(pid=27666) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27666)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=27693): Process ended prematurely: osmo-stp_10.42.42.5(pid=27693) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27693)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=27705): Process ended prematurely: osmo-stp_10.42.42.5(pid=27705) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27705)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=27723): Process ended prematurely: osmo-stp_10.42.42.5(pid=27723) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27723)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27733): Process ended prematurely: osmo-stp_10.42.42.5(pid=27733) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27743): Process ended prematurely: osmo-stp_10.42.42.5(pid=27743) [trial-2358↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27743)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27756): Process ended prematurely: osmo-stp_10.42.42.5(pid=27756) [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27756)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27769): Process ended prematurely: osmo-stp_10.42.42.5(pid=27769) [trial-2358↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27769)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=27777): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27777) [trial-2358↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27777)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27787): Process ended prematurely: osmo-stp_10.42.42.5(pid=27787) [trial-2358↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27787)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27796): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27796) [trial-2358↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27796)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27806): Process ended prematurely: osmo-stp_10.42.42.5(pid=27806) [trial-2358↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27806)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27821): Process ended prematurely: osmo-stp_10.42.42.5(pid=27821) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27821)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27832): Process ended prematurely: osmo-stp_10.42.42.5(pid=27832) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27832)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27846): Process ended prematurely: osmo-stp_10.42.42.5(pid=27846) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27846)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27857): Process ended prematurely: osmo-stp_10.42.42.5(pid=27857) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27857)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27871): Process ended prematurely: osmo-stp_10.42.42.5(pid=27871) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27871)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27882): Process ended prematurely: osmo-stp_10.42.42.5(pid=27882) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27882)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27896): Process ended prematurely: osmo-stp_10.42.42.5(pid=27896) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27896)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27910): Process ended prematurely: osmo-stp_10.42.42.5(pid=27910) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27910)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27924): Process ended prematurely: osmo-stp_10.42.42.5(pid=27924) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27924)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27935): Process ended prematurely: osmo-stp_10.42.42.5(pid=27935) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27935)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27949): Process ended prematurely: osmo-stp_10.42.42.5(pid=27949) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27949)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27960): Process ended prematurely: osmo-stp_10.42.42.5(pid=27960) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27960)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27974): Process ended prematurely: osmo-stp_10.42.42.5(pid=27974) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27974)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27985): Process ended prematurely: osmo-stp_10.42.42.5(pid=27985) [trial-2358↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27985)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27999): Process ended prematurely: osmo-stp_10.42.42.5(pid=27999) [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27999)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28010): Process ended prematurely: osmo-stp_10.42.42.5(pid=28010) [trial-2358↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28010)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=28030): Process ended prematurely: osmo-stp_10.42.42.5(pid=28030) [trial-2358↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28030)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28042): Process ended prematurely: osmo-stp_10.42.42.5(pid=28042) [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28042)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=28060): Process ended prematurely: osmo-stp_10.42.42.5(pid=28060) [trial-2358↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28060)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28070): Process ended prematurely: osmo-stp_10.42.42.5(pid=28070) [trial-2358↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28070)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28081): Process ended prematurely: osmo-stp_10.42.42.5(pid=28081) [trial-2358↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28098): Process ended prematurely: osmo-stp_10.42.42.5(pid=28098) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28098)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=28110): Process ended prematurely: osmo-stp_10.42.42.5(pid=28110) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28110)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28128): Process ended prematurely: osmo-stp_10.42.42.5(pid=28128) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28128)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28138): Process ended prematurely: osmo-stp_10.42.42.5(pid=28138) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28138)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28148): Process ended prematurely: osmo-stp_10.42.42.5(pid=28148) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28148)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28165): Process ended prematurely: osmo-stp_10.42.42.5(pid=28165) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28165)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28178): Process ended prematurely: osmo-stp_10.42.42.5(pid=28178) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28178)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=28196): Process ended prematurely: osmo-stp_10.42.42.5(pid=28196) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28209): Process ended prematurely: osmo-stp_10.42.42.5(pid=28209) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28209)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28219): Process ended prematurely: osmo-stp_10.42.42.5(pid=28219) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28219)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28236): Process ended prematurely: osmo-stp_10.42.42.5(pid=28236) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28236)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28251): Process ended prematurely: osmo-stp_10.42.42.5(pid=28251) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28251)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=28269): Process ended prematurely: osmo-stp_10.42.42.5(pid=28269) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28269)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28279): Process ended prematurely: osmo-stp_10.42.42.5(pid=28279) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28279)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28289): Process ended prematurely: osmo-stp_10.42.42.5(pid=28289) [trial-2358↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28289)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28302): Process ended prematurely: osmo-stp_10.42.42.5(pid=28302) [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28302)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28317): Process ended prematurely: osmo-stp_10.42.42.5(pid=28317) [trial-2358↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28317)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28326) [trial-2358↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28326)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28336): Process ended prematurely: osmo-stp_10.42.42.5(pid=28336) [trial-2358↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28336)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28345): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28345) [trial-2358↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28345)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28355): Process ended prematurely: osmo-stp_10.42.42.5(pid=28355) [trial-2358↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28355)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28369): Process ended prematurely: osmo-stp_10.42.42.5(pid=28369) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28369)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28380): Process ended prematurely: osmo-stp_10.42.42.5(pid=28380) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28380)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28394): Process ended prematurely: osmo-stp_10.42.42.5(pid=28394) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28394)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28405): Process ended prematurely: osmo-stp_10.42.42.5(pid=28405) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28405)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28419): Process ended prematurely: osmo-stp_10.42.42.5(pid=28419) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28419)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28430): Process ended prematurely: osmo-stp_10.42.42.5(pid=28430) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28430)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28444): Process ended prematurely: osmo-stp_10.42.42.5(pid=28444) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28455): Process ended prematurely: osmo-stp_10.42.42.5(pid=28455) [trial-2358↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28455)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=28741): Process ended prematurely: osmo-stp_10.42.42.5(pid=28741) [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28752): Process ended prematurely: osmo-stp_10.42.42.5(pid=28752) [trial-2358↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28752)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28768): Process ended prematurely: osmo-stp_10.42.42.5(pid=28768) [trial-2358↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28768)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28779): Process ended prematurely: osmo-stp_10.42.42.5(pid=28779) [trial-2358↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28779)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28797): Process ended prematurely: osmo-stp_10.42.42.5(pid=28797) [trial-2358↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28797)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=28810): Process ended prematurely: osmo-stp_10.42.42.5(pid=28810) [trial-2358↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28810)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=28828): Process ended prematurely: osmo-stp_10.42.42.5(pid=28828) [trial-2358↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28828)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2358↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28848): Process ended prematurely: osmo-stp_10.42.42.5(pid=28848) [trial-2358↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28848)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28869): Process ended prematurely: osmo-stp_10.42.42.5(pid=28869) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28869)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28899): Process ended prematurely: osmo-stp_10.42.42.5(pid=28899) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28909): Process ended prematurely: osmo-stp_10.42.42.5(pid=28909) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28909)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28919): Process ended prematurely: osmo-stp_10.42.42.5(pid=28919) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28919)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28937): Process ended prematurely: osmo-stp_10.42.42.5(pid=28937) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28937)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28949): Process ended prematurely: osmo-stp_10.42.42.5(pid=28949) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28949)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28967): Process ended prematurely: osmo-stp_10.42.42.5(pid=28967) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28967)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28977): Process ended prematurely: osmo-stp_10.42.42.5(pid=28977) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28977)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28987): Process ended prematurely: osmo-stp_10.42.42.5(pid=28987) [trial-2358↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28987)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29000): Process ended prematurely: osmo-stp_10.42.42.5(pid=29000) [trial-2358↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29000)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29015): Process ended prematurely: osmo-stp_10.42.42.5(pid=29015) [trial-2358↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29024): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29024) [trial-2358↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29024)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29034): Process ended prematurely: osmo-stp_10.42.42.5(pid=29034) [trial-2358↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29034)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29050): Process ended prematurely: osmo-stp_10.42.42.5(pid=29050) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29061): Process ended prematurely: osmo-stp_10.42.42.5(pid=29061) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29061)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29075): Process ended prematurely: osmo-stp_10.42.42.5(pid=29075) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29075)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29086): Process ended prematurely: osmo-stp_10.42.42.5(pid=29086) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29086)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29100): Process ended prematurely: osmo-stp_10.42.42.5(pid=29100) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29100)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29111): Process ended prematurely: osmo-stp_10.42.42.5(pid=29111) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29111)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29126): Process ended prematurely: osmo-stp_10.42.42.5(pid=29126) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29126)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29137): Process ended prematurely: osmo-stp_10.42.42.5(pid=29137) [trial-2358↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29137)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29151): Process ended prematurely: osmo-stp_10.42.42.5(pid=29151) [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29151)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29162): Process ended prematurely: osmo-stp_10.42.42.5(pid=29162) [trial-2358↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29162)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29176): Process ended prematurely: osmo-stp_10.42.42.5(pid=29176) [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29176)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29188): Process ended prematurely: osmo-stp_10.42.42.5(pid=29188) [trial-2358↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29188)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29202): Process ended prematurely: osmo-stp_10.42.42.5(pid=29202) [trial-2358↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29202)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29213): Process ended prematurely: osmo-stp_10.42.42.5(pid=29213) [trial-2358↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29213)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29236): Process ended prematurely: osmo-stp_10.42.42.5(pid=29236) [trial-2358↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29236)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29248): Process ended prematurely: osmo-stp_10.42.42.5(pid=29248) [trial-2358↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29248)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29266): Process ended prematurely: osmo-stp_10.42.42.5(pid=29266) [trial-2358↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29266)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29276): Process ended prematurely: osmo-stp_10.42.42.5(pid=29276) [trial-2358↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29276)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29286): Process ended prematurely: osmo-stp_10.42.42.5(pid=29286) [trial-2358↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29286)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=29303): Process ended prematurely: osmo-stp_10.42.42.5(pid=29303) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29303)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29315): Process ended prematurely: osmo-stp_10.42.42.5(pid=29315) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=29333): Process ended prematurely: osmo-stp_10.42.42.5(pid=29333) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29333)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29343): Process ended prematurely: osmo-stp_10.42.42.5(pid=29343) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29343)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29353): Process ended prematurely: osmo-stp_10.42.42.5(pid=29353) [trial-2358↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29353)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29371): Process ended prematurely: osmo-stp_10.42.42.5(pid=29371) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29383): Process ended prematurely: osmo-stp_10.42.42.5(pid=29383) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29383)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29402): Process ended prematurely: osmo-stp_10.42.42.5(pid=29402) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29402)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29412): Process ended prematurely: osmo-stp_10.42.42.5(pid=29412) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29412)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29423): Process ended prematurely: osmo-stp_10.42.42.5(pid=29423) [trial-2358↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29423)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29440): Process ended prematurely: osmo-stp_10.42.42.5(pid=29440) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29440)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29452): Process ended prematurely: osmo-stp_10.42.42.5(pid=29452) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29452)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29480): Process ended prematurely: osmo-stp_10.42.42.5(pid=29480) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29480)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29490): Process ended prematurely: osmo-stp_10.42.42.5(pid=29490) [trial-2358↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29490)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29503): Process ended prematurely: osmo-stp_10.42.42.5(pid=29503) [trial-2358↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29503)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=29511): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29511) [trial-2358↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29511)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=29513): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29513) [trial-2358↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29513)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=29515): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29515) [trial-2358↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29515)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=29517): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29517) [trial-2358↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29517)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=29528): Process ended prematurely: osmo-hlr_10.42.42.2(pid=29528) [trial-2358↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29528)] FAIL: esme_connect_policy_closed.py (6.4 sec) Error: osmo-hlr_10.42.42.2(pid=29539): Process ended prematurely: osmo-hlr_10.42.42.2(pid=29539) [trial-2358↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29539)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29551): Process ended prematurely: osmo-stp_10.42.42.5(pid=29551) [trial-2358↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29551)] FAIL: esme_ms_sms_transaction.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29562): Process ended prematurely: osmo-stp_10.42.42.5(pid=29562) [trial-2358↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29579): Process ended prematurely: osmo-stp_10.42.42.5(pid=29579) [trial-2358↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29579)] FAIL: register_a5_0_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29590): Process ended prematurely: osmo-stp_10.42.42.5(pid=29590) [trial-2358↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] FAIL: register_a5_1_authreq.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29601): Process ended prematurely: osmo-stp_10.42.42.5(pid=29601) [trial-2358↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29601)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29612): Process ended prematurely: osmo-stp_10.42.42.5(pid=29612) [trial-2358↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29612)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.8 sec) Error: srsepc(pid=29632): Process ended prematurely: srsepc(pid=29632) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29632)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=29648): Process ended prematurely: srsepc(pid=29648) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29648)] FAIL: iperf3_dl.py (18.6 sec) Error: srsepc(pid=29664): Process ended prematurely: srsepc(pid=29664) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29664)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=29680): Process ended prematurely: srsepc(pid=29680) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29680)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=29696): Process ended prematurely: srsepc(pid=29696) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29696)] FAIL: rrc_idle_mo_ping.py (18.7 sec) Error: srsepc(pid=29715): Process ended prematurely: srsepc(pid=29715) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29715)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=29731): Process ended prematurely: srsepc(pid=29731) [trial-2358↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=29731)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30015): Process ended prematurely: osmo-stp_10.42.42.5(pid=30015) [trial-2358↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30015)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=30029): Process ended prematurely: osmo-stp_10.42.42.5(pid=30029) [trial-2358↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30029)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30044): Process ended prematurely: osmo-stp_10.42.42.5(pid=30044) [trial-2358↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30044)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30059): Process ended prematurely: osmo-stp_10.42.42.5(pid=30059) [trial-2358↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30059)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30074): Process ended prematurely: osmo-stp_10.42.42.5(pid=30074) [trial-2358↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30074)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30088): Process ended prematurely: osmo-stp_10.42.42.5(pid=30088) [trial-2358↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30102): Process ended prematurely: osmo-stp_10.42.42.5(pid=30102) [trial-2358↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30116): Process ended prematurely: osmo-stp_10.42.42.5(pid=30116) [trial-2358↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30116)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30131): Process ended prematurely: osmo-stp_10.42.42.5(pid=30131) [trial-2358↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30131)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30145): Process ended prematurely: osmo-stp_10.42.42.5(pid=30145) [trial-2358↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30145)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30162): Process ended prematurely: osmo-stp_10.42.42.5(pid=30162) [trial-2358↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30176): Process ended prematurely: osmo-stp_10.42.42.5(pid=30176) [trial-2358↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30176)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30190): Process ended prematurely: osmo-stp_10.42.42.5(pid=30190) [trial-2358↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30190)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30204): Process ended prematurely: osmo-stp_10.42.42.5(pid=30204) [trial-2358↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30204)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30218): Process ended prematurely: osmo-stp_10.42.42.5(pid=30218) [trial-2358↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30218)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30232): Process ended prematurely: osmo-stp_10.42.42.5(pid=30232) [trial-2358↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30232)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=30246): Process ended prematurely: osmo-stp_10.42.42.5(pid=30246) [trial-2358↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30260): Process ended prematurely: osmo-stp_10.42.42.5(pid=30260) [trial-2358↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30260)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30283): Process ended prematurely: osmo-stp_10.42.42.5(pid=30283) [trial-2358↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30297): Process ended prematurely: osmo-stp_10.42.42.5(pid=30297) [trial-2358↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30297)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30311): Process ended prematurely: osmo-stp_10.42.42.5(pid=30311) [trial-2358↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30311)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30325): Process ended prematurely: osmo-stp_10.42.42.5(pid=30325) [trial-2358↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30325)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30339): Process ended prematurely: osmo-stp_10.42.42.5(pid=30339) [trial-2358↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30339)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30357): Process ended prematurely: osmo-stp_10.42.42.5(pid=30357) [trial-2358↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30357)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30371): Process ended prematurely: osmo-stp_10.42.42.5(pid=30371) [trial-2358↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30371)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=30385): Process ended prematurely: osmo-stp_10.42.42.5(pid=30385) [trial-2358↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30385)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30399): Process ended prematurely: osmo-stp_10.42.42.5(pid=30399) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30399)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30413): Process ended prematurely: osmo-stp_10.42.42.5(pid=30413) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30413)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30427): Process ended prematurely: osmo-stp_10.42.42.5(pid=30427) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30427)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30442): Process ended prematurely: osmo-stp_10.42.42.5(pid=30442) [trial-2358↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30442)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30457): Process ended prematurely: osmo-stp_10.42.42.5(pid=30457) [trial-2358↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30457)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30471): Process ended prematurely: osmo-stp_10.42.42.5(pid=30471) [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30471)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30485): Process ended prematurely: osmo-stp_10.42.42.5(pid=30485) [trial-2358↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30485)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30499): Process ended prematurely: osmo-stp_10.42.42.5(pid=30499) [trial-2358↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30499)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30513): Process ended prematurely: osmo-stp_10.42.42.5(pid=30513) [trial-2358↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30513)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30527): Process ended prematurely: osmo-stp_10.42.42.5(pid=30527) [trial-2358↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30527)] + rm -rf trial-2358/inst + cd trial-2358 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 09:50:07 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358-run.tgz run.2022-12-09_09-50-18 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2358-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2947.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29259.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30035.tgz osmo-stp.build-9238.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE